2024-05-08T20:42:48.427 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T20:42:48.427 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries} --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022 -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/orig.config.yaml 2024-05-08T20:42:48.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:42:48.553 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries} email: pdonnell@redhat.com first_in_suite: false job_id: '7698022' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: client.0: - fs/maxentries teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T20:42:48.553 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T20:42:48.554 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T20:42:48.554 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T20:42:48.556 INFO:teuthology.task.internal:Checking packages... 2024-05-08T20:42:48.584 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T20:42:48.584 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T20:42:48.584 INFO:teuthology.packaging:ref: None 2024-05-08T20:42:48.584 INFO:teuthology.packaging:tag: None 2024-05-08T20:42:48.584 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:42:48.584 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:42:48.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:42:48.906 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:42:48.907 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T20:42:48.914 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T20:42:48.914 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T20:42:48.921 INFO:teuthology.task.internal:Saving configuration 2024-05-08T20:42:48.938 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T20:42:48.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T20:42:48.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:36:26.765022', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-05-08T20:42:48.987 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 20:36:26.766254', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-05-08T20:42:48.987 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T20:42:48.994 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-08T20:42:48.994 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-08T20:42:48.994 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T20:42:49.061 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f11ac1354c0>, signals=[15]) 2024-05-08T20:42:49.062 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T20:42:49.068 INFO:teuthology.task.internal:Opening connections... 2024-05-08T20:42:49.069 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T20:42:49.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:42:49.161 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T20:42:49.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:42:49.261 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T20:42:49.268 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-05-08T20:42:49.275 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-05-08T20:42:49.276 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2024-05-08T20:42:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T20:42:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T20:42:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T20:42:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T20:42:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2024-05-08T20:42:49.327 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2024-05-08T20:42:49.328 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-05-08T20:42:49.348 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-05-08T20:42:49.354 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-05-08T20:42:49.355 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="20.04" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T20:42:49.403 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=focal 2024-05-08T20:42:49.404 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=focal 2024-05-08T20:42:49.404 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-05-08T20:42:49.423 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T20:42:49.433 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T20:42:49.440 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T20:42:49.440 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:42:49.443 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-05-08T20:42:49.449 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T20:42:49.455 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T20:42:49.455 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:42:49.490 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-05-08T20:42:49.551 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T20:42:49.596 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T20:42:49.610 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T20:42:49.611 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T20:42:49.611 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:42:49.612 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T20:42:49.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:42:49.617 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-08T20:42:49.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:42:49.618 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-05-08T20:42:49.624 INFO:teuthology.orchestra.run.smithi107.stdout:5.4.0-124-generic 2024-05-08T20:42:49.625 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.4.0-124-generic 2024-05-08T20:42:49.625 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-05-08T20:42:49.667 INFO:teuthology.orchestra.run.smithi195.stdout:5.4.0-124-generic 2024-05-08T20:42:49.667 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.4.0-124-generic 2024-05-08T20:42:49.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get clean 2024-05-08T20:42:49.775 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-05-08T20:42:49.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-08T20:42:49.974 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-05-08T20:42:49.980 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-05-08T20:42:49.996 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-05-08T20:42:50.060 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-05-08T20:42:50.060 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-05-08T20:42:50.124 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-05-08T20:42:50.185 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-05-08T20:42:50.378 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,920 kB] 2024-05-08T20:42:50.501 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-05-08T20:42:50.528 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,296 kB] 2024-05-08T20:42:50.532 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [748 kB] 2024-05-08T20:42:50.688 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,296 kB] 2024-05-08T20:42:50.782 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [748 kB] 2024-05-08T20:42:50.808 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [438 kB] 2024-05-08T20:42:50.823 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-05-08T20:42:50.824 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,799 kB] 2024-05-08T20:42:50.893 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,920 kB] 2024-05-08T20:42:50.941 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-05-08T20:42:50.941 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [391 kB] 2024-05-08T20:42:50.945 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-05-08T20:42:50.945 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [657 kB] 2024-05-08T20:42:50.975 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [959 kB] 2024-05-08T20:42:50.991 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [972 kB] 2024-05-08T20:42:50.994 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [202 kB] 2024-05-08T20:42:50.999 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-05-08T20:42:51.000 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-05-08T20:42:51.000 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-05-08T20:42:51.016 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [520 kB] 2024-05-08T20:42:51.031 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-05-08T20:42:51.031 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-05-08T20:42:51.031 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,916 kB] 2024-05-08T20:42:51.042 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-05-08T20:42:51.042 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-05-08T20:42:51.087 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [438 kB] 2024-05-08T20:42:51.090 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [407 kB] 2024-05-08T20:42:51.098 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-05-08T20:42:51.099 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,185 kB] 2024-05-08T20:42:51.101 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-05-08T20:42:51.103 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-05-08T20:42:51.103 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,799 kB] 2024-05-08T20:42:51.121 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-05-08T20:42:51.136 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [284 kB] 2024-05-08T20:42:51.140 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-05-08T20:42:51.140 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-05-08T20:42:51.141 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-05-08T20:42:51.141 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-05-08T20:42:51.170 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-05-08T20:42:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-05-08T20:42:51.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-05-08T20:42:51.172 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-05-08T20:42:51.179 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [391 kB] 2024-05-08T20:42:51.187 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-05-08T20:42:51.187 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [959 kB] 2024-05-08T20:42:51.201 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-05-08T20:42:51.202 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-05-08T20:42:51.203 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-05-08T20:42:51.223 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [657 kB] 2024-05-08T20:42:51.398 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [202 kB] 2024-05-08T20:42:51.825 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-05-08T20:42:51.831 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-05-08T20:42:51.838 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-05-08T20:42:51.840 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-05-08T20:42:51.842 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-05-08T20:42:54.918 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 20.2 MB in 3s (6,431 kB/s) 2024-05-08T20:42:56.385 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:42:56.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:42:56.483 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:42:56.695 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-08T20:42:56.696 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-08T20:42:56.903 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-08T20:42:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-5.4.0-181 linux-headers-5.4.0-181-generic 2024-05-08T20:42:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-generic linux-image-5.4.0-181-generic 2024-05-08T20:42:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-5.4.0-181-generic linux-modules-extra-5.4.0-181-generic 2024-05-08T20:42:56.905 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-08T20:42:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-05-08T20:42:56.905 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-05-08T20:42:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: thermald 2024-05-08T20:42:56.974 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-08T20:42:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-5.4.0-181 linux-headers-5.4.0-181-generic 2024-05-08T20:42:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-181-generic linux-modules-5.4.0-181-generic 2024-05-08T20:42:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-extra-5.4.0-181-generic 2024-05-08T20:42:56.976 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-05-08T20:42:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T20:42:57.158 INFO:teuthology.orchestra.run.smithi107.stdout:3 upgraded, 5 newly installed, 0 to remove and 299 not upgraded. 2024-05-08T20:42:57.158 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 77.1 MB of archives. 2024-05-08T20:42:57.158 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 380 MB of additional disk space will be used. 2024-05-08T20:42:57.158 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-181-generic amd64 5.4.0-181.201 [15.0 MB] 2024-05-08T20:42:57.433 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [972 kB] 2024-05-08T20:42:57.645 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [520 kB] 2024-05-08T20:42:57.693 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-05-08T20:42:57.726 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,916 kB] 2024-05-08T20:42:57.863 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-05-08T20:42:57.906 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [407 kB] 2024-05-08T20:42:57.958 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-05-08T20:42:58.000 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,185 kB] 2024-05-08T20:42:58.064 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-05-08T20:42:58.122 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [284 kB] 2024-05-08T20:42:58.172 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-05-08T20:42:58.215 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-05-08T20:42:58.255 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-05-08T20:42:58.299 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-05-08T20:42:58.335 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-05-08T20:42:58.417 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-181-generic amd64 5.4.0-181.201 [10.5 MB] 2024-05-08T20:42:58.450 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-05-08T20:42:58.490 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-05-08T20:42:58.529 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-05-08T20:42:58.565 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-05-08T20:42:58.596 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-05-08T20:42:58.630 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-05-08T20:42:58.687 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-181-generic amd64 5.4.0-181.201 [39.2 MB] 2024-05-08T20:42:59.981 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.181.179 [1,896 B] 2024-05-08T20:42:59.981 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.181.179 [2,596 B] 2024-05-08T20:42:59.981 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-181 all 5.4.0-181.201 [11.0 MB] 2024-05-08T20:43:00.366 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-181-generic amd64 5.4.0-181.201 [1,383 kB] 2024-05-08T20:43:00.385 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.181.179 [2,464 B] 2024-05-08T20:43:00.939 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 20.2 MB in 9s (2,295 kB/s) 2024-05-08T20:43:01.080 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 77.1 MB in 3s (22.7 MB/s) 2024-05-08T20:43:01.253 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-5.4.0-181-generic. 2024-05-08T20:43:02.411 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:43:02.440 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:43:02.515 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:43:02.726 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-05-08T20:43:02.727 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-05-08T20:43:02.927 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-05-08T20:43:02.927 INFO:teuthology.orchestra.run.smithi195.stdout: linux-generic linux-headers-5.4.0-181 linux-headers-5.4.0-181-generic 2024-05-08T20:43:02.927 INFO:teuthology.orchestra.run.smithi195.stdout: linux-headers-generic linux-image-5.4.0-181-generic 2024-05-08T20:43:02.927 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-5.4.0-181-generic linux-modules-extra-5.4.0-181-generic 2024-05-08T20:43:02.928 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-05-08T20:43:02.928 INFO:teuthology.orchestra.run.smithi195.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-05-08T20:43:02.928 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2024-05-08T20:43:02.929 INFO:teuthology.orchestra.run.smithi195.stdout: thermald 2024-05-08T20:43:02.955 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-05-08T20:43:02.960 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../0-linux-modules-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:02.989 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-05-08T20:43:02.989 INFO:teuthology.orchestra.run.smithi195.stdout: linux-headers-5.4.0-181 linux-headers-5.4.0-181-generic 2024-05-08T20:43:02.989 INFO:teuthology.orchestra.run.smithi195.stdout: linux-image-5.4.0-181-generic linux-modules-5.4.0-181-generic 2024-05-08T20:43:02.989 INFO:teuthology.orchestra.run.smithi195.stdout: linux-modules-extra-5.4.0-181-generic 2024-05-08T20:43:02.990 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-05-08T20:43:02.991 INFO:teuthology.orchestra.run.smithi195.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T20:43:03.042 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:03.138 INFO:teuthology.orchestra.run.smithi195.stdout:3 upgraded, 5 newly installed, 0 to remove and 299 not upgraded. 2024-05-08T20:43:03.138 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 77.1 MB of archives. 2024-05-08T20:43:03.138 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 380 MB of additional disk space will be used. 2024-05-08T20:43:03.138 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-181-generic amd64 5.4.0-181.201 [15.0 MB] 2024-05-08T20:43:03.792 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-181-generic amd64 5.4.0-181.201 [10.5 MB] 2024-05-08T20:43:03.983 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-181-generic amd64 5.4.0-181.201 [39.2 MB] 2024-05-08T20:43:04.912 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.181.179 [1,896 B] 2024-05-08T20:43:04.912 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.181.179 [2,596 B] 2024-05-08T20:43:04.913 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-181 all 5.4.0-181.201 [11.0 MB] 2024-05-08T20:43:04.960 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-image-5.4.0-181-generic. 2024-05-08T20:43:04.974 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../1-linux-image-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:05.078 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:05.659 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-181-generic amd64 5.4.0-181.201 [1,383 kB] 2024-05-08T20:43:05.755 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.181.179 [2,464 B] 2024-05-08T20:43:06.155 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-181-generic. 2024-05-08T20:43:06.169 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:06.212 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-extra-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:06.474 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 77.1 MB in 3s (28.0 MB/s) 2024-05-08T20:43:06.657 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-modules-5.4.0-181-generic. 2024-05-08T20:43:08.366 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-05-08T20:43:08.372 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../0-linux-modules-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:08.438 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-modules-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:10.380 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-image-5.4.0-181-generic. 2024-05-08T20:43:10.393 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../1-linux-image-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:10.488 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:10.879 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../3-linux-generic_5.4.0.181.179_amd64.deb ... 2024-05-08T20:43:11.015 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-generic (5.4.0.181.179) over (5.4.0.124.125) ... 2024-05-08T20:43:11.390 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.181.179_amd64.deb ... 2024-05-08T20:43:11.501 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-generic (5.4.0.181.179) over (5.4.0.124.125) ... 2024-05-08T20:43:11.549 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-181-generic. 2024-05-08T20:43:11.563 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:11.607 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-modules-extra-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:11.829 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.4.0-181. 2024-05-08T20:43:11.845 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../5-linux-headers-5.4.0-181_5.4.0-181.201_all.deb ... 2024-05-08T20:43:11.887 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.4.0-181 (5.4.0-181.201) ... 2024-05-08T20:43:16.081 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../3-linux-generic_5.4.0.181.179_amd64.deb ... 2024-05-08T20:43:16.204 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-generic (5.4.0.181.179) over (5.4.0.124.125) ... 2024-05-08T20:43:16.546 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.181.179_amd64.deb ... 2024-05-08T20:43:16.675 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-image-generic (5.4.0.181.179) over (5.4.0.124.125) ... 2024-05-08T20:43:17.019 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-headers-5.4.0-181. 2024-05-08T20:43:17.036 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../5-linux-headers-5.4.0-181_5.4.0-181.201_all.deb ... 2024-05-08T20:43:17.078 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-5.4.0-181 (5.4.0-181.201) ... 2024-05-08T20:43:17.812 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.4.0-181-generic. 2024-05-08T20:43:17.833 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../6-linux-headers-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:17.870 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:20.423 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.181.179_amd64.deb ... 2024-05-08T20:43:20.624 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-generic (5.4.0.181.179) over (5.4.0.124.125) ... 2024-05-08T20:43:21.063 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:22.268 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:22.289 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package linux-headers-5.4.0-181-generic. 2024-05-08T20:43:22.311 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../6-linux-headers-5.4.0-181-generic_5.4.0-181.201_amd64.deb ... 2024-05-08T20:43:22.355 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:23.415 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-181-generic 2024-05-08T20:43:23.416 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:23.561 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.4.0-181 (5.4.0-181.201) ... 2024-05-08T20:43:23.696 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:23.822 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-extra-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:24.999 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-generic (5.4.0.181.179) ... 2024-05-08T20:43:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-generic (5.4.0.181.179) ... 2024-05-08T20:43:25.251 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-generic (5.4.0.181.179) ... 2024-05-08T20:43:25.377 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for linux-image-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:25.400 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.181.179_amd64.deb ... 2024-05-08T20:43:25.458 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T20:43:25.458 INFO:teuthology.orchestra.run.smithi107.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:25.521 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking linux-headers-generic (5.4.0.181.179) over (5.4.0.124.125) ... 2024-05-08T20:43:25.855 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-modules-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:27.060 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:28.206 INFO:teuthology.orchestra.run.smithi195.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-181-generic 2024-05-08T20:43:28.207 INFO:teuthology.orchestra.run.smithi195.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:28.345 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-5.4.0-181 (5.4.0-181.201) ... 2024-05-08T20:43:28.471 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:28.597 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-modules-extra-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:29.791 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-headers-generic (5.4.0.181.179) ... 2024-05-08T20:43:29.916 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-image-generic (5.4.0.181.179) ... 2024-05-08T20:43:30.042 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up linux-generic (5.4.0.181.179) ... 2024-05-08T20:43:30.169 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for linux-image-5.4.0-181-generic (5.4.0-181.201) ... 2024-05-08T20:43:30.239 INFO:teuthology.orchestra.run.smithi195.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T20:43:30.239 INFO:teuthology.orchestra.run.smithi195.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:47.892 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T20:43:47.893 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub' 2024-05-08T20:43:47.910 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:43:47.925 INFO:teuthology.orchestra.run.smithi107.stdout:Generating grub configuration file ... 2024-05-08T20:43:48.271 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.4.0-181-generic 2024-05-08T20:43:48.300 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:48.693 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-05-08T20:43:48.705 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-05-08T20:43:50.873 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-05-08T20:43:51.294 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 20 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-05-08T20:43:51.340 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.4.0.181.179 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.4.0-181-generic, linux-modules-extra-5.4.0-181-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:43:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-05-08T20:43:51.341 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-181-generic 2024-05-08T20:43:51.341 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T20:43:51.342 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T20:43:51.342 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T20:43:51.342 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T20:43:51.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-05-08T20:43:51.423 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-08T20:43:51.604 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-05-08T20:43:51.604 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-05-08T20:43:51.646 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-05-08T20:43:51.734 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-05-08T20:43:52.477 INFO:teuthology.orchestra.run.smithi195.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T20:43:52.477 INFO:teuthology.orchestra.run.smithi195.stdout:Sourcing file `/etc/default/grub' 2024-05-08T20:43:52.482 INFO:teuthology.orchestra.run.smithi195.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:43:52.502 INFO:teuthology.orchestra.run.smithi195.stdout:Generating grub configuration file ... 2024-05-08T20:43:52.804 INFO:teuthology.orchestra.run.smithi195.stdout:Found linux image: /boot/vmlinuz-5.4.0-181-generic 2024-05-08T20:43:52.822 INFO:teuthology.orchestra.run.smithi195.stdout:Found initrd image: /boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:53.204 INFO:teuthology.orchestra.run.smithi195.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-05-08T20:43:53.215 INFO:teuthology.orchestra.run.smithi195.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-05-08T20:43:53.411 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:43:53.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:43:53.512 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:43:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-08T20:43:53.725 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-08T20:43:53.951 INFO:teuthology.orchestra.run.smithi107.stdout:linux-image-generic is already the newest version (5.4.0.181.179). 2024-05-08T20:43:53.952 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 0 newly installed, 0 to remove and 299 not upgraded. 2024-05-08T20:43:53.953 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-05-08T20:43:53.974 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-05-08T20:43:53.974 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-05-08T20:43:53.974 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 20 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.4.0.181.179 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.4.0-181-generic, linux-modules-extra-5.4.0-181-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:43:53.975 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-05-08T20:43:53.976 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-05-08T20:43:53.976 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:43:53.976 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-05-08T20:43:53.976 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-08T20:43:54.024 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.zdCJ0rXanu 2024-05-08T20:43:54.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zdCJ0rXanu 2024-05-08T20:43:54.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.zdCJ0rXanu 2024-05-08T20:43:54.145 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.zdCJ0rXanu is 9KB 2024-05-08T20:43:54.159 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.zdCJ0rXanu 2024-05-08T20:43:54.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T20:43:54.220 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:43:54.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T20:43:54.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T20:43:54.253 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-181-generic 2024-05-08T20:43:54.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo update-grub 2024-05-08T20:43:55.417 INFO:teuthology.orchestra.run.smithi195.stdout:done 2024-05-08T20:43:55.574 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2024-05-08T20:43:55.583 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:43:55.595 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-05-08T20:43:55.792 DEBUG:teuthology.orchestra.run.smithi195:> dpkg -s linux-image-generic 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Package: linux-image-generic 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Status: install ok installed 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Priority: optional 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Section: kernel 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Installed-Size: 20 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:43:55.846 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: amd64 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout:Source: linux-meta 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout:Version: 5.4.0.181.179 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout:Depends: linux-image-5.4.0-181-generic, linux-modules-extra-5.4.0-181-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout:Recommends: thermald 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout:Description: Generic Linux kernel image 2024-05-08T20:43:55.847 INFO:teuthology.orchestra.run.smithi195.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:43:55.848 INFO:teuthology.orchestra.run.smithi195.stdout: available. 2024-05-08T20:43:55.848 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-181-generic 2024-05-08T20:43:55.848 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T20:43:55.848 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T20:43:55.848 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-08T20:43:55.848 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T20:43:55.848 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get clean 2024-05-08T20:43:55.861 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-181-generic 2024-05-08T20:43:55.872 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-181-generic 2024-05-08T20:43:55.918 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-05-08T20:43:56.072 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-05-08T20:43:56.072 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-05-08T20:43:56.084 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-05-08T20:43:56.105 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-05-08T20:43:56.227 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-05-08T20:43:56.239 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-05-08T20:43:57.269 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-05-08T20:43:57.271 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-05-08T20:43:57.892 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:43:57.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T20:43:57.990 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:43:58.231 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-05-08T20:43:58.232 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-05-08T20:43:58.466 INFO:teuthology.orchestra.run.smithi195.stdout:linux-image-generic is already the newest version (5.4.0.181.179). 2024-05-08T20:43:58.466 INFO:teuthology.orchestra.run.smithi195.stdout:0 upgraded, 0 newly installed, 0 to remove and 299 not upgraded. 2024-05-08T20:43:58.468 DEBUG:teuthology.orchestra.run.smithi195:> dpkg -s linux-image-generic 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Package: linux-image-generic 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Status: install ok installed 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Priority: optional 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Section: kernel 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Installed-Size: 20 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: amd64 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Source: linux-meta 2024-05-08T20:43:58.489 INFO:teuthology.orchestra.run.smithi195.stdout:Version: 5.4.0.181.179 2024-05-08T20:43:58.490 INFO:teuthology.orchestra.run.smithi195.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-05-08T20:43:58.490 INFO:teuthology.orchestra.run.smithi195.stdout:Depends: linux-image-5.4.0-181-generic, linux-modules-extra-5.4.0-181-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T20:43:58.490 INFO:teuthology.orchestra.run.smithi195.stdout:Recommends: thermald 2024-05-08T20:43:58.490 INFO:teuthology.orchestra.run.smithi195.stdout:Description: Generic Linux kernel image 2024-05-08T20:43:58.490 INFO:teuthology.orchestra.run.smithi195.stdout: This package will always depend on the latest generic kernel image 2024-05-08T20:43:58.490 INFO:teuthology.orchestra.run.smithi195.stdout: available. 2024-05-08T20:43:58.490 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-05-08T20:43:58.495 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.a4ZBNPtjWY 2024-05-08T20:43:58.495 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub/grub.cfg /tmp/tmp.a4ZBNPtjWY 2024-05-08T20:43:58.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.a4ZBNPtjWY 2024-05-08T20:43:58.596 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.a4ZBNPtjWY is 9KB 2024-05-08T20:43:58.610 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.a4ZBNPtjWY 2024-05-08T20:43:58.617 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T20:43:58.676 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:43:58.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T20:43:58.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T20:43:58.758 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-181-generic 2024-05-08T20:43:58.759 DEBUG:teuthology.orchestra.run.smithi195:> sudo update-grub 2024-05-08T20:43:59.985 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub' 2024-05-08T20:43:59.991 INFO:teuthology.orchestra.run.smithi195.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T20:44:00.005 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-05-08T20:44:00.260 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-181-generic 2024-05-08T20:44:00.274 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-181-generic 2024-05-08T20:44:00.672 INFO:teuthology.orchestra.run.smithi195.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-05-08T20:44:00.683 INFO:teuthology.orchestra.run.smithi195.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-05-08T20:44:01.658 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-05-08T20:44:01.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-05-08T20:44:27.298 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T20:44:27.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:44:27.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:44:31.666 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-08T20:44:31.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:44:31.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:44:45.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-08T20:44:50.082 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-05-08T20:44:54.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:44:54.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:44:57.794 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-08T20:44:59.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:44:59.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:45:02.143 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-05-08T20:45:09.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:45:09.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:45:14.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:45:14.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:45:28.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-08T20:45:32.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-05-08T20:45:43.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:45:43.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:45:43.883 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-08T20:45:45.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:45:45.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-181-generic"... 2024-05-08T20:45:45.092 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-08T20:45:45.140 INFO:teuthology.orchestra.run.smithi107.stdout:5.4.0-181-generic 2024-05-08T20:45:45.141 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-181-generic vs 5.4.0-181-generic 2024-05-08T20:45:45.141 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T20:45:45.141 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T20:45:46.142 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T20:45:46.142 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T20:45:46.278 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-05-08T20:45:46.309 DEBUG:teuthology.parallel:result is None 2024-05-08T20:45:47.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:45:47.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:45:47.829 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-05-08T20:45:48.402 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:45:48.402 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-181-generic"... 2024-05-08T20:45:48.402 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-05-08T20:45:48.408 INFO:teuthology.orchestra.run.smithi195.stdout:5.4.0-181-generic 2024-05-08T20:45:48.409 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-181-generic vs 5.4.0-181-generic 2024-05-08T20:45:48.409 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T20:45:48.409 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T20:45:49.410 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T20:45:49.410 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T20:45:49.506 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-05-08T20:45:49.535 DEBUG:teuthology.parallel:result is None 2024-05-08T20:45:49.535 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T20:45:49.542 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T20:45:49.543 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:45:49.545 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T20:45:49.552 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T20:45:49.564 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T20:45:49.575 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T20:45:49.575 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:45:49.597 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T20:45:49.620 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T20:45:49.626 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T20:45:49.627 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:45:49.629 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T20:45:49.653 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:45:49.662 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:45:49.674 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:45:49.683 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T20:45:49.685 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T20:45:49.692 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T20:45:49.692 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:45:49.695 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T20:45:49.709 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T20:45:49.732 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T20:45:49.732 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:45:49.753 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T20:45:49.760 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:45:49.765 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:45:49.772 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:45:49.772 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:45:49.835 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T20:45:49.842 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T20:45:49.849 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:45:49.849 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T20:45:49.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-05-08T20:45:49.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-05-08T20:45:49.964 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T20:45:49.971 INFO:teuthology.task.internal:Starting timer... 2024-05-08T20:45:49.971 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T20:45:49.981 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T20:45:49.989 DEBUG:teuthology.task.selinux:Excluding smithi107: OS 'ubuntu' does not support SELinux 2024-05-08T20:45:49.989 DEBUG:teuthology.task.selinux:Excluding smithi195: OS 'ubuntu' does not support SELinux 2024-05-08T20:45:49.989 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T20:45:49.989 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-08T20:45:49.990 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T20:45:49.990 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T20:45:49.998 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T20:45:50.004 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T20:45:50.132 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T20:45:50.150 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T20:45:50.151 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T20:52:14.310 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-05-08T20:52:14.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:52:14.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:52:14.421 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-08T20:52:14.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-08T20:52:14.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:52:14.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T20:52:14.630 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-05-08T20:52:14.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-05-08T20:52:14.760 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T20:52:14.770 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T20:52:14.771 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T20:52:14.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:52:14.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T20:52:14.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:52:14.801 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-05-08T20:52:14.801 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Command line: ntpd -gq 2024-05-08T20:52:14.801 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: proto: precision = 0.051 usec (-24) 2024-05-08T20:52:14.801 INFO:teuthology.orchestra.run.smithi107.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:52:14.802 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:52:14.802 INFO:teuthology.orchestra.run.smithi107.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:52:14.803 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:52:14.803 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T20:52:14.803 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T20:52:14.803 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T20:52:14.803 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listen normally on 3 enp3s0f1 172.21.15.107:123 2024-05-08T20:52:14.804 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listen normally on 4 lo [::1]:123 2024-05-08T20:52:14.804 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47eb%5]:123 2024-05-08T20:52:14.804 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:14 ntpd[13004]: Listening on routing socket on fd #22 for interface updates 2024-05-08T20:52:14.806 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-05-08T20:52:14.806 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Command line: ntpd -gq 2024-05-08T20:52:14.807 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: proto: precision = 0.117 usec (-23) 2024-05-08T20:52:14.808 INFO:teuthology.orchestra.run.smithi195.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:52:14.808 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T20:52:14.808 INFO:teuthology.orchestra.run.smithi195.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:52:14.809 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T20:52:14.809 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T20:52:14.809 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T20:52:14.810 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T20:52:14.810 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listen normally on 3 enp3s0f1 172.21.15.195:123 2024-05-08T20:52:14.810 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listen normally on 4 lo [::1]:123 2024-05-08T20:52:14.810 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8081%5]:123 2024-05-08T20:52:14.810 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:14 ntpd[13005]: Listening on routing socket on fd #22 for interface updates 2024-05-08T20:52:15.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:15 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:15 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:15 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:15 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:15 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:15.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:15 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:15.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:15.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:15 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:16.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:16 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:16.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:16 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:16.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:16 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:16.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:16 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:16.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:16 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:16.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:16 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:17.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:17.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:17 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:17.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:17.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:17 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:18.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:18.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:18 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:19.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:19.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:19.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:19 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:19.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:19.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:19.810 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:19.810 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:19.810 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:19.810 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:19 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:20.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:20 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:20.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:20 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:20.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:20 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:20.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:20 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:20.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:20 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:20.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:20 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:21.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.802 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: 8 May 20:52:21 ntpd[13004]: ntpd: time slew -0.001346 s 2024-05-08T20:52:21.803 INFO:teuthology.orchestra.run.smithi107.stdout:ntpd: time slew -0.001346s 2024-05-08T20:52:21.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T20:52:21.804 INFO:teuthology.orchestra.run.smithi107.stderr: 8 May 20:52:21 ntpd[13004]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T20:52:21.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.807 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stdout: 8 May 20:52:21 ntpd[13005]: ntpd: time slew -0.000597 s 2024-05-08T20:52:21.808 INFO:teuthology.orchestra.run.smithi195.stdout:ntpd: time slew -0.000597s 2024-05-08T20:52:21.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T20:52:21.809 INFO:teuthology.orchestra.run.smithi195.stderr: 8 May 20:52:21 ntpd[13005]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T20:52:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T20:52:21.868 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-05-08T20:52:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.882 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T20:52:21.882 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-05-08T20:52:21.882 INFO:teuthology.orchestra.run.smithi195.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.882 INFO:teuthology.orchestra.run.smithi195.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.882 INFO:teuthology.orchestra.run.smithi195.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.882 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-05-08T20:52:21.883 INFO:teuthology.run_tasks:Running task install... 2024-05-08T20:52:21.892 DEBUG:teuthology.task.install:project ceph 2024-05-08T20:52:21.892 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T20:52:21.892 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T20:52:21.892 INFO:teuthology.task.install:Using flavor: default 2024-05-08T20:52:21.899 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T20:52:21.899 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T20:52:21.899 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2024-05-08T20:52:21.900 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-key list | grep Ceph 2024-05-08T20:52:21.999 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-05-08T20:52:22.026 INFO:teuthology.orchestra.run.smithi195.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-05-08T20:52:22.059 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T20:52:22.059 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T20:52:22.060 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-08T20:52:22.060 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-08T20:52:22.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:52:22.086 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T20:52:22.086 INFO:teuthology.orchestra.run.smithi195.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T20:52:22.087 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-08T20:52:22.087 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-08T20:52:22.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:52:22.288 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default/ 2024-05-08T20:52:22.288 INFO:teuthology.task.install.deb:Package version is 18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:52:22.305 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default/ 2024-05-08T20:52:22.305 INFO:teuthology.task.install.deb:Package version is 18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:52:22.403 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:52:22.403 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T20:52:22.418 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:52:22.418 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T20:52:22.420 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-08T20:52:22.435 DEBUG:teuthology.orchestra.run.smithi195:> sudo apt-get update 2024-05-08T20:52:22.565 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-05-08T20:52:22.565 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-05-08T20:52:22.572 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-05-08T20:52:22.592 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-05-08T20:52:22.614 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal InRelease 2024-05-08T20:52:22.626 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal InRelease 2024-05-08T20:52:22.636 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-05-08T20:52:22.648 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-05-08T20:52:22.659 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal Release.gpg 2024-05-08T20:52:22.671 INFO:teuthology.orchestra.run.smithi195.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal Release.gpg 2024-05-08T20:52:22.704 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2024-05-08T20:52:22.704 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-05-08T20:52:22.709 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-05-08T20:52:22.710 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-05-08T20:52:22.758 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main i386 Packages [3,414 B] 2024-05-08T20:52:22.759 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main i386 Packages [3,414 B] 2024-05-08T20:52:22.774 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-05-08T20:52:22.862 INFO:teuthology.orchestra.run.smithi195.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-05-08T20:52:23.248 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 28.7 kB in 1s (43.6 kB/s) 2024-05-08T20:52:23.372 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 28.7 kB in 1s (36.9 kB/s) 2024-05-08T20:52:24.357 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:52:24.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1322-gd21e4f96-1focal cephadm=18.2.2-1322-gd21e4f96-1focal ceph-mds=18.2.2-1322-gd21e4f96-1focal ceph-mgr=18.2.2-1322-gd21e4f96-1focal ceph-common=18.2.2-1322-gd21e4f96-1focal ceph-fuse=18.2.2-1322-gd21e4f96-1focal ceph-test=18.2.2-1322-gd21e4f96-1focal ceph-volume=18.2.2-1322-gd21e4f96-1focal radosgw=18.2.2-1322-gd21e4f96-1focal python3-rados=18.2.2-1322-gd21e4f96-1focal python3-rgw=18.2.2-1322-gd21e4f96-1focal python3-cephfs=18.2.2-1322-gd21e4f96-1focal python3-rbd=18.2.2-1322-gd21e4f96-1focal libcephfs2=18.2.2-1322-gd21e4f96-1focal libcephfs-dev=18.2.2-1322-gd21e4f96-1focal librados2=18.2.2-1322-gd21e4f96-1focal librbd1=18.2.2-1322-gd21e4f96-1focal rbd-fuse=18.2.2-1322-gd21e4f96-1focal python3-cephfs=18.2.2-1322-gd21e4f96-1focal cephfs-shell=18.2.2-1322-gd21e4f96-1focal cephfs-top=18.2.2-1322-gd21e4f96-1focal cephfs-mirror=18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:52:24.453 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:52:24.475 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:52:24.501 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1322-gd21e4f96-1focal cephadm=18.2.2-1322-gd21e4f96-1focal ceph-mds=18.2.2-1322-gd21e4f96-1focal ceph-mgr=18.2.2-1322-gd21e4f96-1focal ceph-common=18.2.2-1322-gd21e4f96-1focal ceph-fuse=18.2.2-1322-gd21e4f96-1focal ceph-test=18.2.2-1322-gd21e4f96-1focal ceph-volume=18.2.2-1322-gd21e4f96-1focal radosgw=18.2.2-1322-gd21e4f96-1focal python3-rados=18.2.2-1322-gd21e4f96-1focal python3-rgw=18.2.2-1322-gd21e4f96-1focal python3-cephfs=18.2.2-1322-gd21e4f96-1focal python3-rbd=18.2.2-1322-gd21e4f96-1focal libcephfs2=18.2.2-1322-gd21e4f96-1focal libcephfs-dev=18.2.2-1322-gd21e4f96-1focal librados2=18.2.2-1322-gd21e4f96-1focal librbd1=18.2.2-1322-gd21e4f96-1focal rbd-fuse=18.2.2-1322-gd21e4f96-1focal python3-cephfs=18.2.2-1322-gd21e4f96-1focal cephfs-shell=18.2.2-1322-gd21e4f96-1focal cephfs-top=18.2.2-1322-gd21e4f96-1focal cephfs-mirror=18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:52:24.568 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:52:24.640 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-08T20:52:24.640 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-08T20:52:24.780 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-05-08T20:52:24.780 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-05-08T20:52:24.821 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:52:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-05-08T20:52:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-05-08T20:52:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-05-08T20:52:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-05-08T20:52:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-05-08T20:52:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-05-08T20:52:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-05-08T20:52:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: qttranslations5-l10n socat xmlstarlet 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-05-08T20:52:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: btrfs-tools 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-05-08T20:52:24.944 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-05-08T20:52:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-05-08T20:52:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-05-08T20:52:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-05-08T20:52:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-05-08T20:52:24.947 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-05-08T20:52:24.948 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-05-08T20:52:24.948 INFO:teuthology.orchestra.run.smithi107.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-05-08T20:52:24.948 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-05-08T20:52:24.948 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 librbd1 2024-05-08T20:52:24.967 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:52:24.968 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-05-08T20:52:24.969 INFO:teuthology.orchestra.run.smithi195.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-05-08T20:52:24.971 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-05-08T20:52:24.971 INFO:teuthology.orchestra.run.smithi195.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-05-08T20:52:24.971 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-05-08T20:52:24.971 INFO:teuthology.orchestra.run.smithi195.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-05-08T20:52:24.971 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-05-08T20:52:24.971 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-05-08T20:52:24.972 INFO:teuthology.orchestra.run.smithi195.stdout: qttranslations5-l10n socat xmlstarlet 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout:Recommended packages: 2024-05-08T20:52:24.973 INFO:teuthology.orchestra.run.smithi195.stdout: btrfs-tools 2024-05-08T20:52:25.094 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-05-08T20:52:25.094 INFO:teuthology.orchestra.run.smithi195.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T20:52:25.094 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T20:52:25.094 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-08T20:52:25.094 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-05-08T20:52:25.095 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-05-08T20:52:25.095 INFO:teuthology.orchestra.run.smithi195.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-05-08T20:52:25.095 INFO:teuthology.orchestra.run.smithi195.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-05-08T20:52:25.097 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-05-08T20:52:25.098 INFO:teuthology.orchestra.run.smithi195.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-05-08T20:52:25.099 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-05-08T20:52:25.099 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 librbd1 2024-05-08T20:52:25.112 INFO:teuthology.orchestra.run.smithi107.stdout:2 upgraded, 116 newly installed, 0 to remove and 278 not upgraded. 2024-05-08T20:52:25.112 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 199 MB of archives. 2024-05-08T20:52:25.112 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 977 MB of additional disk space will be used. 2024-05-08T20:52:25.112 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1322-gd21e4f96-1focal [3,446 kB] 2024-05-08T20:52:25.140 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-05-08T20:52:25.168 INFO:teuthology.orchestra.run.smithi195.stdout:2 upgraded, 116 newly installed, 0 to remove and 278 not upgraded. 2024-05-08T20:52:25.168 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 199 MB of archives. 2024-05-08T20:52:25.168 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 977 MB of additional disk space will be used. 2024-05-08T20:52:25.168 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-05-08T20:52:25.189 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-05-08T20:52:25.197 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-05-08T20:52:25.224 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-05-08T20:52:25.227 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-05-08T20:52:25.261 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-05-08T20:52:25.262 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-05-08T20:52:25.266 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-05-08T20:52:25.281 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-05-08T20:52:25.321 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1322-gd21e4f96-1focal [3,446 kB] 2024-05-08T20:52:25.330 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-05-08T20:52:25.332 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-05-08T20:52:25.339 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-05-08T20:52:25.341 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-05-08T20:52:25.341 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-05-08T20:52:25.342 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-05-08T20:52:25.343 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-05-08T20:52:25.346 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-05-08T20:52:25.346 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-05-08T20:52:25.351 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-05-08T20:52:25.368 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-05-08T20:52:25.369 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-05-08T20:52:25.370 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-05-08T20:52:25.372 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T20:52:25.372 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-05-08T20:52:25.373 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-05-08T20:52:25.375 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-05-08T20:52:25.376 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-05-08T20:52:25.378 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-05-08T20:52:25.391 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-05-08T20:52:25.391 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-05-08T20:52:25.397 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-05-08T20:52:25.399 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-05-08T20:52:25.410 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-05-08T20:52:25.411 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-05-08T20:52:25.411 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-05-08T20:52:25.413 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-05-08T20:52:25.415 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-05-08T20:52:25.416 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-05-08T20:52:25.419 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-05-08T20:52:25.430 INFO:teuthology.orchestra.run.smithi195.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-05-08T20:52:25.433 INFO:teuthology.orchestra.run.smithi195.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-05-08T20:52:25.435 INFO:teuthology.orchestra.run.smithi195.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-05-08T20:52:25.450 INFO:teuthology.orchestra.run.smithi195.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-05-08T20:52:25.451 INFO:teuthology.orchestra.run.smithi195.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-05-08T20:52:25.452 INFO:teuthology.orchestra.run.smithi195.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-05-08T20:52:25.454 INFO:teuthology.orchestra.run.smithi195.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-05-08T20:52:25.454 INFO:teuthology.orchestra.run.smithi195.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-05-08T20:52:25.455 INFO:teuthology.orchestra.run.smithi195.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-05-08T20:52:25.458 INFO:teuthology.orchestra.run.smithi195.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T20:52:25.470 INFO:teuthology.orchestra.run.smithi195.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-05-08T20:52:25.471 INFO:teuthology.orchestra.run.smithi195.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-05-08T20:52:25.472 INFO:teuthology.orchestra.run.smithi195.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-05-08T20:52:25.490 INFO:teuthology.orchestra.run.smithi195.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-05-08T20:52:25.490 INFO:teuthology.orchestra.run.smithi195.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-05-08T20:52:25.491 INFO:teuthology.orchestra.run.smithi195.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-05-08T20:52:25.504 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1322-gd21e4f96-1focal [4,035 kB] 2024-05-08T20:52:25.532 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-05-08T20:52:25.549 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-05-08T20:52:25.595 INFO:teuthology.orchestra.run.smithi195.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-05-08T20:52:25.613 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-05-08T20:52:25.617 INFO:teuthology.orchestra.run.smithi195.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-05-08T20:52:25.618 INFO:teuthology.orchestra.run.smithi195.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-05-08T20:52:25.635 INFO:teuthology.orchestra.run.smithi195.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-05-08T20:52:25.635 INFO:teuthology.orchestra.run.smithi195.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-05-08T20:52:25.636 INFO:teuthology.orchestra.run.smithi195.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-05-08T20:52:25.683 INFO:teuthology.orchestra.run.smithi195.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-05-08T20:52:25.683 INFO:teuthology.orchestra.run.smithi195.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-05-08T20:52:25.685 INFO:teuthology.orchestra.run.smithi195.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-05-08T20:52:25.685 INFO:teuthology.orchestra.run.smithi195.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-05-08T20:52:25.687 INFO:teuthology.orchestra.run.smithi195.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-05-08T20:52:25.688 INFO:teuthology.orchestra.run.smithi195.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-05-08T20:52:25.689 INFO:teuthology.orchestra.run.smithi195.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-05-08T20:52:25.693 INFO:teuthology.orchestra.run.smithi195.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-05-08T20:52:25.703 INFO:teuthology.orchestra.run.smithi195.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-05-08T20:52:25.716 INFO:teuthology.orchestra.run.smithi195.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-05-08T20:52:25.717 INFO:teuthology.orchestra.run.smithi195.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-05-08T20:52:25.721 INFO:teuthology.orchestra.run.smithi195.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-05-08T20:52:25.725 INFO:teuthology.orchestra.run.smithi195.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-05-08T20:52:25.725 INFO:teuthology.orchestra.run.smithi195.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-05-08T20:52:25.732 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1322-gd21e4f96-1focal [744 kB] 2024-05-08T20:52:25.743 INFO:teuthology.orchestra.run.smithi195.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-05-08T20:52:25.746 INFO:teuthology.orchestra.run.smithi195.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-05-08T20:52:25.747 INFO:teuthology.orchestra.run.smithi195.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-05-08T20:52:25.801 INFO:teuthology.orchestra.run.smithi195.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-05-08T20:52:25.801 INFO:teuthology.orchestra.run.smithi195.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-05-08T20:52:25.801 INFO:teuthology.orchestra.run.smithi195.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-05-08T20:52:25.802 INFO:teuthology.orchestra.run.smithi195.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-05-08T20:52:25.806 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1322-gd21e4f96-1focal [387 kB] 2024-05-08T20:52:25.810 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-05-08T20:52:25.816 INFO:teuthology.orchestra.run.smithi195.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T20:52:25.816 INFO:teuthology.orchestra.run.smithi195.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-05-08T20:52:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-05-08T20:52:25.817 INFO:teuthology.orchestra.run.smithi195.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-05-08T20:52:25.818 INFO:teuthology.orchestra.run.smithi195.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-05-08T20:52:25.819 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-05-08T20:52:25.846 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-05-08T20:52:25.854 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-05-08T20:52:25.979 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1322-gd21e4f96-1focal [31.9 kB] 2024-05-08T20:52:25.987 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1322-gd21e4f96-1focal [201 kB] 2024-05-08T20:52:26.001 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1322-gd21e4f96-1focal [62.5 kB] 2024-05-08T20:52:26.003 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1322-gd21e4f96-1focal [365 kB] 2024-05-08T20:52:26.019 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-05-08T20:52:26.020 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1322-gd21e4f96-1focal [6,591 kB] 2024-05-08T20:52:26.235 INFO:teuthology.orchestra.run.smithi195.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1322-gd21e4f96-1focal [4,035 kB] 2024-05-08T20:52:26.292 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1322-gd21e4f96-1focal [113 kB] 2024-05-08T20:52:26.294 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1322-gd21e4f96-1focal [476 kB] 2024-05-08T20:52:26.314 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1322-gd21e4f96-1focal [25.1 MB] 2024-05-08T20:52:26.385 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-05-08T20:52:26.404 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-05-08T20:52:26.580 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-05-08T20:52:26.589 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-05-08T20:52:26.623 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-05-08T20:52:26.629 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-05-08T20:52:26.632 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-05-08T20:52:26.634 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-05-08T20:52:26.644 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T20:52:26.645 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-05-08T20:52:26.812 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-05-08T20:52:27.131 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-05-08T20:52:27.154 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-05-08T20:52:27.224 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-05-08T20:52:27.286 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-05-08T20:52:27.294 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-05-08T20:52:27.414 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-05-08T20:52:27.415 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-05-08T20:52:27.419 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-05-08T20:52:27.423 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-05-08T20:52:27.434 INFO:teuthology.orchestra.run.smithi107.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-05-08T20:52:27.449 INFO:teuthology.orchestra.run.smithi195.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1322-gd21e4f96-1focal [744 kB] 2024-05-08T20:52:27.579 INFO:teuthology.orchestra.run.smithi195.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1322-gd21e4f96-1focal [387 kB] 2024-05-08T20:52:27.621 INFO:teuthology.orchestra.run.smithi107.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-05-08T20:52:27.642 INFO:teuthology.orchestra.run.smithi195.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1322-gd21e4f96-1focal [31.9 kB] 2024-05-08T20:52:27.644 INFO:teuthology.orchestra.run.smithi195.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1322-gd21e4f96-1focal [201 kB] 2024-05-08T20:52:27.769 INFO:teuthology.orchestra.run.smithi195.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1322-gd21e4f96-1focal [62.5 kB] 2024-05-08T20:52:27.772 INFO:teuthology.orchestra.run.smithi195.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1322-gd21e4f96-1focal [365 kB] 2024-05-08T20:52:27.775 INFO:teuthology.orchestra.run.smithi107.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1322-gd21e4f96-1focal [9,604 kB] 2024-05-08T20:52:27.783 INFO:teuthology.orchestra.run.smithi195.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1322-gd21e4f96-1focal [6,591 kB] 2024-05-08T20:52:27.857 INFO:teuthology.orchestra.run.smithi107.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-05-08T20:52:28.082 INFO:teuthology.orchestra.run.smithi107.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1322-gd21e4f96-1focal [238 kB] 2024-05-08T20:52:28.187 INFO:teuthology.orchestra.run.smithi107.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1322-gd21e4f96-1focal [148 kB] 2024-05-08T20:52:28.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1322-gd21e4f96-1focal [1,573 kB] 2024-05-08T20:52:28.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-05-08T20:52:28.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-05-08T20:52:28.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1322-gd21e4f96-1focal [6,637 kB] 2024-05-08T20:52:28.188 INFO:teuthology.orchestra.run.smithi107.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-05-08T20:52:28.209 INFO:teuthology.orchestra.run.smithi107.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-05-08T20:52:28.215 INFO:teuthology.orchestra.run.smithi107.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-05-08T20:52:28.222 INFO:teuthology.orchestra.run.smithi107.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-05-08T20:52:28.226 INFO:teuthology.orchestra.run.smithi107.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-05-08T20:52:28.240 INFO:teuthology.orchestra.run.smithi107.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-05-08T20:52:28.241 INFO:teuthology.orchestra.run.smithi107.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-05-08T20:52:28.395 INFO:teuthology.orchestra.run.smithi107.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1322-gd21e4f96-1focal [24.5 MB] 2024-05-08T20:52:28.410 INFO:teuthology.orchestra.run.smithi107.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-05-08T20:52:28.819 INFO:teuthology.orchestra.run.smithi107.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T20:52:28.822 INFO:teuthology.orchestra.run.smithi107.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-05-08T20:52:28.881 INFO:teuthology.orchestra.run.smithi107.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-05-08T20:52:29.045 INFO:teuthology.orchestra.run.smithi107.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-05-08T20:52:29.072 INFO:teuthology.orchestra.run.smithi107.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-05-08T20:52:29.075 INFO:teuthology.orchestra.run.smithi107.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-05-08T20:52:29.085 INFO:teuthology.orchestra.run.smithi107.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-05-08T20:52:29.390 INFO:teuthology.orchestra.run.smithi195.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1322-gd21e4f96-1focal [113 kB] 2024-05-08T20:52:29.395 INFO:teuthology.orchestra.run.smithi195.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1322-gd21e4f96-1focal [476 kB] 2024-05-08T20:52:29.408 INFO:teuthology.orchestra.run.smithi107.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1322-gd21e4f96-1focal [13.7 kB] 2024-05-08T20:52:29.409 INFO:teuthology.orchestra.run.smithi107.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1322-gd21e4f96-1focal [854 kB] 2024-05-08T20:52:29.421 INFO:teuthology.orchestra.run.smithi107.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1322-gd21e4f96-1focal [2,291 kB] 2024-05-08T20:52:29.450 INFO:teuthology.orchestra.run.smithi107.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1322-gd21e4f96-1focal [237 kB] 2024-05-08T20:52:29.458 INFO:teuthology.orchestra.run.smithi107.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1322-gd21e4f96-1focal [143 kB] 2024-05-08T20:52:29.463 INFO:teuthology.orchestra.run.smithi107.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1322-gd21e4f96-1focal [7,012 kB] 2024-05-08T20:52:29.497 INFO:teuthology.orchestra.run.smithi195.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1322-gd21e4f96-1focal [25.1 MB] 2024-05-08T20:52:29.595 INFO:teuthology.orchestra.run.smithi107.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-05-08T20:52:29.653 INFO:teuthology.orchestra.run.smithi107.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-05-08T20:52:29.656 INFO:teuthology.orchestra.run.smithi107.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-05-08T20:52:29.738 INFO:teuthology.orchestra.run.smithi107.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1322-gd21e4f96-1focal [7,876 kB] 2024-05-08T20:52:29.856 INFO:teuthology.orchestra.run.smithi107.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-05-08T20:52:29.939 INFO:teuthology.orchestra.run.smithi107.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-05-08T20:52:30.061 INFO:teuthology.orchestra.run.smithi107.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-05-08T20:52:30.118 INFO:teuthology.orchestra.run.smithi107.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-05-08T20:52:30.140 INFO:teuthology.orchestra.run.smithi107.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1322-gd21e4f96-1focal [13.9 kB] 2024-05-08T20:52:30.140 INFO:teuthology.orchestra.run.smithi107.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1322-gd21e4f96-1focal [46.7 MB] 2024-05-08T20:52:30.145 INFO:teuthology.orchestra.run.smithi107.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-05-08T20:52:30.180 INFO:teuthology.orchestra.run.smithi107.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-05-08T20:52:30.192 INFO:teuthology.orchestra.run.smithi107.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-05-08T20:52:30.243 INFO:teuthology.orchestra.run.smithi107.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-05-08T20:52:30.251 INFO:teuthology.orchestra.run.smithi107.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-05-08T20:52:30.265 INFO:teuthology.orchestra.run.smithi107.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-05-08T20:52:30.344 INFO:teuthology.orchestra.run.smithi107.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-05-08T20:52:30.534 INFO:teuthology.orchestra.run.smithi107.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-05-08T20:52:30.906 INFO:teuthology.orchestra.run.smithi107.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-05-08T20:52:30.930 INFO:teuthology.orchestra.run.smithi107.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-05-08T20:52:31.083 INFO:teuthology.orchestra.run.smithi107.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-05-08T20:52:31.138 INFO:teuthology.orchestra.run.smithi107.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-05-08T20:52:31.143 INFO:teuthology.orchestra.run.smithi107.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-05-08T20:52:31.310 INFO:teuthology.orchestra.run.smithi107.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-05-08T20:52:31.320 INFO:teuthology.orchestra.run.smithi107.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-05-08T20:52:31.328 INFO:teuthology.orchestra.run.smithi107.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-05-08T20:52:31.494 INFO:teuthology.orchestra.run.smithi107.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-05-08T20:52:31.494 INFO:teuthology.orchestra.run.smithi107.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-05-08T20:52:31.664 INFO:teuthology.orchestra.run.smithi107.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-05-08T20:52:31.999 INFO:teuthology.orchestra.run.smithi107.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-05-08T20:52:32.166 INFO:teuthology.orchestra.run.smithi107.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1322-gd21e4f96-1focal [119 kB] 2024-05-08T20:52:32.169 INFO:teuthology.orchestra.run.smithi107.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.2-1322-gd21e4f96-1focal [268 kB] 2024-05-08T20:52:32.174 INFO:teuthology.orchestra.run.smithi107.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.2-1322-gd21e4f96-1focal [33.0 kB] 2024-05-08T20:52:32.175 INFO:teuthology.orchestra.run.smithi107.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.2-1322-gd21e4f96-1focal [22.7 kB] 2024-05-08T20:52:32.176 INFO:teuthology.orchestra.run.smithi107.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1322-gd21e4f96-1focal [37.4 kB] 2024-05-08T20:52:32.177 INFO:teuthology.orchestra.run.smithi107.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1322-gd21e4f96-1focal [13.4 MB] 2024-05-08T20:52:32.760 INFO:teuthology.orchestra.run.smithi107.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1322-gd21e4f96-1focal [107 kB] 2024-05-08T20:52:34.328 INFO:teuthology.orchestra.run.smithi195.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1322-gd21e4f96-1focal [9,604 kB] 2024-05-08T20:52:35.164 INFO:teuthology.orchestra.run.smithi107.stdout:Get:114 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T20:52:35.256 INFO:teuthology.orchestra.run.smithi107.stdout:Get:115 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-05-08T20:52:35.526 INFO:teuthology.orchestra.run.smithi195.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1322-gd21e4f96-1focal [238 kB] 2024-05-08T20:52:35.562 INFO:teuthology.orchestra.run.smithi195.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1322-gd21e4f96-1focal [148 kB] 2024-05-08T20:52:35.566 INFO:teuthology.orchestra.run.smithi195.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1322-gd21e4f96-1focal [1,573 kB] 2024-05-08T20:52:35.730 INFO:teuthology.orchestra.run.smithi107.stdout:Get:116 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-05-08T20:52:35.778 INFO:teuthology.orchestra.run.smithi195.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1322-gd21e4f96-1focal [6,637 kB] 2024-05-08T20:52:35.854 INFO:teuthology.orchestra.run.smithi107.stdout:Get:117 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-05-08T20:52:35.971 INFO:teuthology.orchestra.run.smithi107.stdout:Get:118 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-05-08T20:52:36.631 INFO:teuthology.orchestra.run.smithi195.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1322-gd21e4f96-1focal [24.5 MB] 2024-05-08T20:52:39.351 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 199 MB in 14s (14.4 MB/s) 2024-05-08T20:52:39.525 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-08T20:52:39.580 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-05-08T20:52:39.584 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-05-08T20:52:39.623 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-05-08T20:52:39.893 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T20:52:39.906 INFO:teuthology.orchestra.run.smithi195.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1322-gd21e4f96-1focal [13.7 kB] 2024-05-08T20:52:39.909 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-05-08T20:52:39.950 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-05-08T20:52:39.962 INFO:teuthology.orchestra.run.smithi195.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1322-gd21e4f96-1focal [854 kB] 2024-05-08T20:52:39.977 INFO:teuthology.orchestra.run.smithi195.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1322-gd21e4f96-1focal [2,291 kB] 2024-05-08T20:52:40.195 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cmd2. 2024-05-08T20:52:40.212 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-05-08T20:52:40.245 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-05-08T20:52:40.275 INFO:teuthology.orchestra.run.smithi195.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1322-gd21e4f96-1focal [237 kB] 2024-05-08T20:52:40.342 INFO:teuthology.orchestra.run.smithi195.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1322-gd21e4f96-1focal [143 kB] 2024-05-08T20:52:40.346 INFO:teuthology.orchestra.run.smithi195.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1322-gd21e4f96-1focal [7,012 kB] 2024-05-08T20:52:40.581 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-05-08T20:52:40.598 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-05-08T20:52:40.706 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-05-08T20:52:41.060 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T20:52:41.077 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-05-08T20:52:41.118 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-05-08T20:52:41.290 INFO:teuthology.orchestra.run.smithi195.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1322-gd21e4f96-1focal [7,876 kB] 2024-05-08T20:52:41.404 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T20:52:41.424 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-05-08T20:52:41.454 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-05-08T20:52:41.916 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T20:52:41.931 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-05-08T20:52:42.004 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:52:42.378 INFO:teuthology.orchestra.run.smithi195.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1322-gd21e4f96-1focal [13.9 kB] 2024-05-08T20:52:42.378 INFO:teuthology.orchestra.run.smithi195.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1322-gd21e4f96-1focal [46.7 MB] 2024-05-08T20:52:42.519 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T20:52:42.535 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-05-08T20:52:42.577 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:52:43.113 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T20:52:43.129 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-05-08T20:52:43.163 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:52:43.566 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-05-08T20:52:43.582 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-05-08T20:52:43.624 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-05-08T20:52:43.986 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../010-librbd1_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:44.111 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librbd1 (18.2.2-1322-gd21e4f96-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-05-08T20:52:44.757 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../011-librados2_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:44.856 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librados2 (18.2.2-1322-gd21e4f96-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-05-08T20:52:45.577 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T20:52:45.596 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../012-libcephfs2_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:45.635 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:45.996 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rados. 2024-05-08T20:52:46.011 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../013-python3-rados_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:46.054 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rados (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:46.398 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T20:52:46.414 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:52:46.456 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-argparse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:46.725 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T20:52:46.742 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../015-python3-cephfs_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:46.783 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cephfs (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:47.086 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T20:52:47.106 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:52:47.136 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:47.390 INFO:teuthology.orchestra.run.smithi195.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1322-gd21e4f96-1focal [119 kB] 2024-05-08T20:52:47.392 INFO:teuthology.orchestra.run.smithi195.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.2-1322-gd21e4f96-1focal [268 kB] 2024-05-08T20:52:47.398 INFO:teuthology.orchestra.run.smithi195.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.2-1322-gd21e4f96-1focal [33.0 kB] 2024-05-08T20:52:47.399 INFO:teuthology.orchestra.run.smithi195.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.2-1322-gd21e4f96-1focal [22.7 kB] 2024-05-08T20:52:47.400 INFO:teuthology.orchestra.run.smithi195.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1322-gd21e4f96-1focal [37.4 kB] 2024-05-08T20:52:47.401 INFO:teuthology.orchestra.run.smithi195.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1322-gd21e4f96-1focal [13.4 MB] 2024-05-08T20:52:47.439 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T20:52:47.455 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-05-08T20:52:47.489 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-05-08T20:52:47.724 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T20:52:47.740 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../018-python3-rbd_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:47.783 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rbd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:48.144 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-05-08T20:52:48.160 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-05-08T20:52:48.202 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-05-08T20:52:48.301 INFO:teuthology.orchestra.run.smithi195.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1322-gd21e4f96-1focal [107 kB] 2024-05-08T20:52:48.563 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-05-08T20:52:48.581 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-05-08T20:52:48.621 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-05-08T20:52:48.907 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T20:52:48.923 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-05-08T20:52:48.938 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 199 MB in 23s (8,574 kB/s) 2024-05-08T20:52:48.966 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-05-08T20:52:49.085 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-08T20:52:49.141 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-05-08T20:52:49.145 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-05-08T20:52:49.191 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-05-08T20:52:49.319 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librgw2. 2024-05-08T20:52:49.337 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../022-librgw2_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:49.377 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librgw2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:49.452 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T20:52:49.468 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-05-08T20:52:49.518 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-05-08T20:52:49.797 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cmd2. 2024-05-08T20:52:49.814 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-05-08T20:52:49.872 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-05-08T20:52:50.242 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-05-08T20:52:50.254 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T20:52:50.257 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-05-08T20:52:50.271 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../023-python3-rgw_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:50.312 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:50.341 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-05-08T20:52:50.665 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liboath0. 2024-05-08T20:52:50.682 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-05-08T20:52:50.723 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-05-08T20:52:50.921 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T20:52:50.938 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-05-08T20:52:50.979 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-05-08T20:52:50.993 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T20:52:51.010 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../025-libradosstriper1_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:51.042 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libradosstriper1 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:51.323 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T20:52:51.342 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-05-08T20:52:51.381 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-05-08T20:52:51.504 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-common. 2024-05-08T20:52:51.524 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../026-ceph-common_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:51.562 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:51.835 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T20:52:51.851 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-05-08T20:52:51.903 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:52:52.443 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T20:52:52.455 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-05-08T20:52:52.488 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:52:52.858 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T20:52:52.877 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-05-08T20:52:52.916 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:52:53.355 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-05-08T20:52:53.374 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-05-08T20:52:53.419 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-05-08T20:52:53.792 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../010-librbd1_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:53.890 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librbd1 (18.2.2-1322-gd21e4f96-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-05-08T20:52:54.101 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-base. 2024-05-08T20:52:54.118 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../027-ceph-base_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:54.169 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-base (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:54.586 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../011-librados2_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:54.710 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librados2 (18.2.2-1322-gd21e4f96-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-05-08T20:52:55.371 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T20:52:55.387 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-05-08T20:52:55.429 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-05-08T20:52:55.464 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T20:52:55.484 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../012-libcephfs2_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:55.539 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T20:52:55.725 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-05-08T20:52:55.757 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-05-08T20:52:55.852 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rados. 2024-05-08T20:52:55.872 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../013-python3-rados_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:55.916 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rados (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:56.069 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T20:52:56.086 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-05-08T20:52:56.127 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-05-08T20:52:56.471 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T20:52:56.489 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-05-08T20:52:56.529 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-05-08T20:52:56.832 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-mako. 2024-05-08T20:52:56.848 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-05-08T20:52:56.890 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-05-08T20:52:57.194 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T20:52:57.210 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T20:52:57.252 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:52:57.328 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T20:52:57.343 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:52:57.394 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-argparse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:57.513 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T20:52:57.530 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-05-08T20:52:57.571 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-05-08T20:52:57.655 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T20:52:57.673 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../015-python3-cephfs_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:57.706 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cephfs (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:57.898 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webob. 2024-05-08T20:52:57.915 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-05-08T20:52:57.956 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-05-08T20:52:58.024 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T20:52:58.040 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:52:58.083 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:58.285 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-soupsieve. 2024-05-08T20:52:58.304 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-05-08T20:52:58.342 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-05-08T20:52:58.419 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T20:52:58.435 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-05-08T20:52:58.477 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-05-08T20:52:58.765 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T20:52:58.782 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../018-python3-rbd_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:52:58.826 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rbd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:52:59.193 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-05-08T20:52:59.210 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-05-08T20:52:59.268 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-05-08T20:52:59.329 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bs4. 2024-05-08T20:52:59.348 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-05-08T20:52:59.378 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-05-08T20:52:59.640 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T20:52:59.655 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-05-08T20:52:59.655 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-05-08T20:52:59.671 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-05-08T20:52:59.693 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-05-08T20:52:59.712 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-05-08T20:52:59.993 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T20:53:00.012 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-05-08T20:53:00.051 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-05-08T20:53:00.074 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T20:53:00.091 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-05-08T20:53:00.132 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-05-08T20:53:00.379 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-paste. 2024-05-08T20:53:00.397 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-05-08T20:53:00.439 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-05-08T20:53:00.519 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package librgw2. 2024-05-08T20:53:00.535 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../022-librgw2_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:00.577 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking librgw2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:00.740 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T20:53:00.756 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-05-08T20:53:00.790 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-05-08T20:53:01.101 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T20:53:01.118 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-05-08T20:53:01.159 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-05-08T20:53:01.462 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T20:53:01.462 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T20:53:01.478 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-05-08T20:53:01.479 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../023-python3-rgw_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:01.520 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-05-08T20:53:01.521 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:01.865 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T20:53:01.882 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-05-08T20:53:01.916 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liboath0. 2024-05-08T20:53:01.922 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-05-08T20:53:01.934 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-05-08T20:53:01.974 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-05-08T20:53:02.228 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T20:53:02.246 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-05-08T20:53:02.277 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-05-08T20:53:02.293 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T20:53:02.313 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../025-libradosstriper1_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:02.351 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libradosstriper1 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:02.538 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T20:53:02.556 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:02.596 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:02.847 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-common. 2024-05-08T20:53:02.865 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../026-ceph-common_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:02.905 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:03.010 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T20:53:03.029 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:03.068 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:03.404 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T20:53:03.420 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-05-08T20:53:03.462 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-05-08T20:53:03.731 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cryptography. 2024-05-08T20:53:03.749 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-05-08T20:53:03.789 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-05-08T20:53:04.160 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T20:53:04.176 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-05-08T20:53:04.209 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-05-08T20:53:04.596 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T20:53:04.614 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../051-ceph-mgr_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:04.654 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:05.149 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T20:53:05.166 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../052-ceph-mon_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:05.206 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mon (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:05.394 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-base. 2024-05-08T20:53:05.413 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../027-ceph-base_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:05.462 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-base (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:06.118 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T20:53:06.136 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../053-ceph-osd_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:06.168 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-osd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:06.798 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T20:53:06.815 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-05-08T20:53:06.848 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-05-08T20:53:07.201 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T20:53:07.221 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-05-08T20:53:07.259 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-05-08T20:53:07.579 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T20:53:07.595 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-05-08T20:53:07.638 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-05-08T20:53:07.957 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T20:53:07.977 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-05-08T20:53:08.015 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-05-08T20:53:08.352 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-mako. 2024-05-08T20:53:08.369 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-05-08T20:53:08.435 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-05-08T20:53:08.446 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph. 2024-05-08T20:53:08.462 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../054-ceph_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:08.504 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:08.805 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T20:53:08.825 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T20:53:08.831 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T20:53:08.849 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../055-ceph-fuse_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:08.863 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:53:08.889 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:09.174 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T20:53:09.191 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-05-08T20:53:09.232 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-05-08T20:53:09.318 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T20:53:09.334 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../056-ceph-mds_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:09.376 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mds (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:09.560 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webob. 2024-05-08T20:53:09.576 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2024-05-08T20:53:09.619 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-05-08T20:53:09.845 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephadm. 2024-05-08T20:53:09.864 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../057-cephadm_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:09.903 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:09.997 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-soupsieve. 2024-05-08T20:53:10.013 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-05-08T20:53:10.055 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-05-08T20:53:10.223 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T20:53:10.239 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-05-08T20:53:10.281 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-05-08T20:53:10.391 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-bs4. 2024-05-08T20:53:10.407 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-05-08T20:53:10.449 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-05-08T20:53:10.653 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T20:53:10.670 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-05-08T20:53:10.711 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-05-08T20:53:10.844 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T20:53:10.864 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-05-08T20:53:10.930 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-05-08T20:53:11.056 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T20:53:11.073 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:11.114 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:11.272 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T20:53:11.289 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-05-08T20:53:11.330 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-05-08T20:53:11.459 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jwt. 2024-05-08T20:53:11.475 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-05-08T20:53:11.517 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-05-08T20:53:11.650 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-paste. 2024-05-08T20:53:11.667 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-05-08T20:53:11.708 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-05-08T20:53:11.829 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-attr. 2024-05-08T20:53:11.848 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-05-08T20:53:11.887 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-05-08T20:53:12.045 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T20:53:12.065 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-05-08T20:53:12.103 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-05-08T20:53:12.214 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T20:53:12.233 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-05-08T20:53:12.272 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-05-08T20:53:12.414 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T20:53:12.431 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-05-08T20:53:12.472 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-05-08T20:53:12.584 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-py. 2024-05-08T20:53:12.601 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-05-08T20:53:12.642 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-05-08T20:53:12.809 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T20:53:12.827 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-05-08T20:53:12.867 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-05-08T20:53:12.971 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-atomicwrites. 2024-05-08T20:53:12.987 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-05-08T20:53:13.029 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-05-08T20:53:13.204 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T20:53:13.221 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-05-08T20:53:13.262 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-05-08T20:53:13.340 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-packaging. 2024-05-08T20:53:13.358 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-05-08T20:53:13.398 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-packaging (20.3-1) ... 2024-05-08T20:53:13.625 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T20:53:13.644 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-05-08T20:53:13.701 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T20:53:13.709 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-05-08T20:53:13.721 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-05-08T20:53:13.759 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-05-08T20:53:14.054 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T20:53:14.071 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:14.114 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T20:53:14.119 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:14.131 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T20:53:14.171 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T20:53:14.425 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjs-underscore. 2024-05-08T20:53:14.442 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-05-08T20:53:14.483 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-05-08T20:53:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T20:53:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:14.761 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-05-08T20:53:14.779 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-05-08T20:53:14.835 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-05-08T20:53:14.935 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T20:53:14.951 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-05-08T20:53:14.994 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-05-08T20:53:15.155 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-routes. 2024-05-08T20:53:15.171 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-05-08T20:53:15.213 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-05-08T20:53:15.321 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cryptography. 2024-05-08T20:53:15.339 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-05-08T20:53:15.380 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-05-08T20:53:15.521 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T20:53:15.540 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:15.579 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:15.750 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T20:53:15.767 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-05-08T20:53:15.800 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-05-08T20:53:16.161 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T20:53:16.181 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../051-ceph-mgr_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:16.244 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:16.740 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T20:53:16.757 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../052-ceph-mon_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:16.798 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mon (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:16.900 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-decorator. 2024-05-08T20:53:16.917 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-05-08T20:53:16.958 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-05-08T20:53:17.245 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-05-08T20:53:17.264 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-05-08T20:53:17.311 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-05-08T20:53:17.656 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-scipy. 2024-05-08T20:53:17.671 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-05-08T20:53:17.693 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T20:53:17.713 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../053-ceph-osd_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:17.714 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-05-08T20:53:17.742 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-osd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:18.974 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-05-08T20:53:18.993 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-05-08T20:53:19.032 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-05-08T20:53:19.570 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T20:53:19.589 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-05-08T20:53:19.627 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-05-08T20:53:19.887 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph. 2024-05-08T20:53:19.903 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../054-ceph_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:19.945 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:19.976 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T20:53:19.996 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-05-08T20:53:20.031 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-05-08T20:53:20.307 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T20:53:20.325 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../055-ceph-fuse_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:20.365 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:20.665 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T20:53:20.685 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:20.723 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:20.810 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T20:53:20.826 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../056-ceph-mds_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:20.901 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mds (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:21.404 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephadm. 2024-05-08T20:53:21.420 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../057-cephadm_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:21.454 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:21.773 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T20:53:21.776 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T20:53:21.793 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-05-08T20:53:21.794 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-05-08T20:53:21.831 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-05-08T20:53:21.834 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-05-08T20:53:22.201 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T20:53:22.221 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-05-08T20:53:22.223 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T20:53:22.239 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-05-08T20:53:22.281 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-05-08T20:53:22.282 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-05-08T20:53:22.635 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T20:53:22.651 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-05-08T20:53:22.693 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-05-08T20:53:22.720 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T20:53:22.736 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:22.779 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:22.956 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T20:53:22.972 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-05-08T20:53:23.015 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rsa (4.0-3) ... 2024-05-08T20:53:23.155 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-jwt. 2024-05-08T20:53:23.171 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-05-08T20:53:23.213 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-05-08T20:53:23.327 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T20:53:23.343 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-05-08T20:53:23.386 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-05-08T20:53:23.533 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-attr. 2024-05-08T20:53:23.553 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-05-08T20:53:23.591 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-05-08T20:53:23.689 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-blinker. 2024-05-08T20:53:23.709 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-05-08T20:53:23.747 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-05-08T20:53:23.961 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T20:53:23.976 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-05-08T20:53:24.019 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-05-08T20:53:24.050 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-oauthlib. 2024-05-08T20:53:24.067 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-05-08T20:53:24.100 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-05-08T20:53:24.355 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-py. 2024-05-08T20:53:24.371 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-05-08T20:53:24.421 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T20:53:24.438 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-05-08T20:53:24.446 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-05-08T20:53:24.470 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-05-08T20:53:24.800 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-atomicwrites. 2024-05-08T20:53:24.818 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-05-08T20:53:24.858 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-05-08T20:53:24.905 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T20:53:24.925 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-05-08T20:53:25.073 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-05-08T20:53:25.186 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-packaging. 2024-05-08T20:53:25.203 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-05-08T20:53:25.244 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-packaging (20.3-1) ... 2024-05-08T20:53:25.410 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T20:53:25.427 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-05-08T20:53:25.468 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-05-08T20:53:25.572 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T20:53:25.592 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-05-08T20:53:25.630 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-05-08T20:53:25.990 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T20:53:25.992 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T20:53:26.009 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:26.011 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T20:53:26.048 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:26.050 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T20:53:26.324 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjs-underscore. 2024-05-08T20:53:26.340 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-05-08T20:53:26.376 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T20:53:26.382 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-05-08T20:53:26.396 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-05-08T20:53:26.459 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-05-08T20:53:26.693 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-05-08T20:53:26.708 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-05-08T20:53:26.751 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-05-08T20:53:26.829 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T20:53:26.847 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:53:26.887 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:53:27.095 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-routes. 2024-05-08T20:53:27.111 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-05-08T20:53:27.140 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package jq. 2024-05-08T20:53:27.153 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-05-08T20:53:27.158 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:53:27.198 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:53:27.443 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package socat. 2024-05-08T20:53:27.460 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-05-08T20:53:27.497 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T20:53:27.501 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking socat (1.7.3.3-2) ... 2024-05-08T20:53:27.513 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:27.555 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:27.838 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T20:53:27.858 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-05-08T20:53:27.896 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-05-08T20:53:28.226 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-test. 2024-05-08T20:53:28.245 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:28.283 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-test (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:29.252 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-decorator. 2024-05-08T20:53:29.270 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-05-08T20:53:29.310 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-05-08T20:53:29.622 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-05-08T20:53:29.773 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-05-08T20:53:29.774 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-05-08T20:53:30.025 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-scipy. 2024-05-08T20:53:30.041 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-05-08T20:53:30.091 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-05-08T20:53:31.461 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-05-08T20:53:31.481 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-05-08T20:53:31.533 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-05-08T20:53:32.103 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T20:53:32.119 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-05-08T20:53:32.203 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-05-08T20:53:32.514 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T20:53:32.531 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:32.564 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-volume (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:32.607 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T20:53:32.623 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-05-08T20:53:32.665 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-05-08T20:53:32.926 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-08T20:53:32.945 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:33.009 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephfs-mirror (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:33.363 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-colorama. 2024-05-08T20:53:33.379 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-05-08T20:53:33.421 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-05-08T20:53:33.431 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T20:53:33.448 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:33.489 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:33.683 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephfs-shell. 2024-05-08T20:53:33.701 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../100-cephfs-shell_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:33.741 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephfs-shell (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:33.994 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephfs-top. 2024-05-08T20:53:34.011 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../101-cephfs-top_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:34.052 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephfs-top (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:34.313 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package fonts-mathjax. 2024-05-08T20:53:34.333 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-05-08T20:53:34.371 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:34.634 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T20:53:34.654 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-05-08T20:53:34.709 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-05-08T20:53:34.862 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T20:53:34.879 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:34.920 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs-dev (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:35.114 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T20:53:35.133 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-05-08T20:53:35.172 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-05-08T20:53:35.332 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T20:53:35.350 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-05-08T20:53:35.408 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-05-08T20:53:35.505 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T20:53:35.523 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-05-08T20:53:35.563 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-05-08T20:53:35.753 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T20:53:35.773 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-05-08T20:53:35.811 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-05-08T20:53:35.892 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T20:53:35.908 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-05-08T20:53:35.950 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-rsa (4.0-3) ... 2024-05-08T20:53:36.181 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjs-mathjax. 2024-05-08T20:53:36.199 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-05-08T20:53:36.239 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:36.287 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T20:53:36.303 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-05-08T20:53:36.345 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-05-08T20:53:36.673 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-blinker. 2024-05-08T20:53:36.693 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-05-08T20:53:36.731 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-05-08T20:53:37.068 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-oauthlib. 2024-05-08T20:53:37.084 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-05-08T20:53:37.126 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-05-08T20:53:37.429 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T20:53:37.449 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-05-08T20:53:37.487 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-05-08T20:53:37.815 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T20:53:37.834 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-05-08T20:53:37.898 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-05-08T20:53:37.917 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-natsort-doc. 2024-05-08T20:53:37.939 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-05-08T20:53:37.983 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-05-08T20:53:38.246 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T20:53:38.260 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-05-08T20:53:38.301 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-05-08T20:53:38.353 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webencodings. 2024-05-08T20:53:38.373 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-05-08T20:53:38.411 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-05-08T20:53:38.697 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-html5lib. 2024-05-08T20:53:38.717 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-05-08T20:53:38.755 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-05-08T20:53:38.873 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T20:53:38.890 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:38.965 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:39.092 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-05-08T20:53:39.111 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-05-08T20:53:39.142 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-05-08T20:53:39.335 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T20:53:39.354 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-05-08T20:53:39.393 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-05-08T20:53:39.612 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T20:53:39.628 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T20:53:39.670 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T20:53:39.754 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T20:53:39.771 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:53:39.814 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:53:40.008 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T20:53:40.024 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-05-08T20:53:40.065 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-05-08T20:53:40.115 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package jq. 2024-05-08T20:53:40.132 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:53:40.173 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:53:40.435 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T20:53:40.443 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package socat. 2024-05-08T20:53:40.454 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-05-08T20:53:40.459 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-05-08T20:53:40.492 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking socat (1.7.3.3-2) ... 2024-05-08T20:53:40.493 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-05-08T20:53:40.821 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T20:53:40.830 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T20:53:40.839 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-05-08T20:53:40.846 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-05-08T20:53:40.879 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-05-08T20:53:40.888 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-05-08T20:53:41.157 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T20:53:41.175 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-05-08T20:53:41.215 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-05-08T20:53:41.242 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-test. 2024-05-08T20:53:41.262 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:41.292 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-test (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:41.911 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package radosgw. 2024-05-08T20:53:41.930 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../116-radosgw_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:41.969 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking radosgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:43.397 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T20:53:43.415 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../117-rbd-fuse_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:43.455 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking rbd-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:43.756 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-attr (19.3.0-2) ... 2024-05-08T20:53:44.061 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-05-08T20:53:44.170 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-05-08T20:53:44.296 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-05-08T20:53:44.490 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:45.033 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user cephadm....done 2024-05-08T20:53:45.196 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:45.339 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-05-08T20:53:45.430 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T20:53:45.450 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:45.488 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ceph-volume (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:45.682 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T20:53:45.910 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-08T20:53:45.927 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:45.967 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-mirror (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:46.084 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-05-08T20:53:46.211 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-05-08T20:53:46.296 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-colorama. 2024-05-08T20:53:46.313 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-05-08T20:53:46.379 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-05-08T20:53:46.537 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-05-08T20:53:46.644 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-shell. 2024-05-08T20:53:46.662 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../100-cephfs-shell_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:46.727 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-shell (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:46.971 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package cephfs-top. 2024-05-08T20:53:46.973 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-05-08T20:53:46.990 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../101-cephfs-top_18.2.2-1322-gd21e4f96-1focal_all.deb ... 2024-05-08T20:53:47.020 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking cephfs-top (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:47.258 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-05-08T20:53:47.282 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package fonts-mathjax. 2024-05-08T20:53:47.299 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-05-08T20:53:47.340 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:47.542 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-05-08T20:53:47.819 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-05-08T20:53:47.918 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T20:53:47.936 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:47.977 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libcephfs-dev (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:48.095 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-05-08T20:53:48.387 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-argparse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:48.538 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T20:53:48.555 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-05-08T20:53:48.605 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-05-08T20:53:48.680 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-05-08T20:53:48.806 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-05-08T20:53:48.935 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T20:53:48.952 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-05-08T20:53:48.993 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-05-08T20:53:49.083 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-05-08T20:53:49.359 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-05-08T20:53:49.405 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libjs-mathjax. 2024-05-08T20:53:49.425 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-05-08T20:53:49.466 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:49.643 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-05-08T20:53:49.769 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-05-08T20:53:50.162 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-05-08T20:53:50.439 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-05-08T20:53:50.718 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-05-08T20:53:51.052 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-05-08T20:53:51.131 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python-natsort-doc. 2024-05-08T20:53:51.150 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-05-08T20:53:51.189 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-05-08T20:53:51.362 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-05-08T20:53:51.550 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-webencodings. 2024-05-08T20:53:51.568 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-05-08T20:53:51.608 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-05-08T20:53:51.696 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-05-08T20:53:51.928 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-html5lib. 2024-05-08T20:53:51.947 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-05-08T20:53:51.986 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-05-08T20:53:51.997 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-packaging (20.3-1) ... 2024-05-08T20:53:52.299 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-05-08T20:53:52.323 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-05-08T20:53:52.340 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-05-08T20:53:52.380 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-05-08T20:53:52.433 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-05-08T20:53:52.559 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-05-08T20:53:52.827 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-05-08T20:53:52.892 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T20:53:52.911 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T20:53:52.950 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T20:53:53.220 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-05-08T20:53:53.295 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T20:53:53.315 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-05-08T20:53:53.353 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-05-08T20:53:53.513 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-05-08T20:53:53.748 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T20:53:53.766 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-05-08T20:53:53.806 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-05-08T20:53:53.881 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-05-08T20:53:54.109 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T20:53:54.127 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-05-08T20:53:54.167 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-05-08T20:53:54.243 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up socat (1.7.3.3-2) ... 2024-05-08T20:53:54.370 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:54.462 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T20:53:54.479 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-05-08T20:53:54.520 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-05-08T20:53:54.696 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:53:54.830 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-05-08T20:53:55.174 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-05-08T20:53:55.216 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package radosgw. 2024-05-08T20:53:55.234 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../116-radosgw_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:55.274 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking radosgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:55.294 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-05-08T20:53:55.418 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-05-08T20:53:55.711 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-05-08T20:53:56.395 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:53:56.521 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-05-08T20:53:56.648 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-05-08T20:53:56.710 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T20:53:56.726 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../117-rbd-fuse_18.2.2-1322-gd21e4f96-1focal_amd64.deb ... 2024-05-08T20:53:56.768 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking rbd-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:56.942 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-05-08T20:53:57.095 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-attr (19.3.0-2) ... 2024-05-08T20:53:57.227 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-05-08T20:53:57.431 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-05-08T20:53:57.553 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-05-08T20:53:57.582 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-05-08T20:53:57.678 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:53:57.692 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-05-08T20:53:57.918 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:53:57.963 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-05-08T20:53:58.264 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-05-08T20:53:58.494 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user cephadm....done 2024-05-08T20:53:58.565 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-05-08T20:53:58.687 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:58.809 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-05-08T20:53:59.023 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-05-08T20:53:59.152 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T20:53:59.293 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-05-08T20:53:59.436 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-05-08T20:53:59.444 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-05-08T20:53:59.571 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-05-08T20:53:59.722 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-05-08T20:53:59.762 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-05-08T20:54:00.040 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-05-08T20:54:00.105 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-05-08T20:54:00.264 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-05-08T20:54:00.382 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-05-08T20:54:00.442 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-05-08T20:54:00.700 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-05-08T20:54:00.735 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-05-08T20:54:00.976 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-05-08T20:54:01.053 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-05-08T20:54:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-05-08T20:54:01.639 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-05-08T20:54:01.948 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-argparse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:02.250 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-05-08T20:54:02.386 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-05-08T20:54:02.424 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:54:02.550 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-05-08T20:54:02.690 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-05-08T20:54:02.910 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-05-08T20:54:02.999 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-05-08T20:54:03.211 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-05-08T20:54:03.284 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-05-08T20:54:03.410 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-05-08T20:54:03.495 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:54:03.621 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-05-08T20:54:03.812 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-05-08T20:54:03.973 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-05-08T20:54:04.300 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-05-08T20:54:04.520 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-05-08T20:54:04.659 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-05-08T20:54:04.830 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-05-08T20:54:04.969 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-05-08T20:54:05.190 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-05-08T20:54:05.474 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-05-08T20:54:05.800 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-05-08T20:54:05.967 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-05-08T20:54:06.093 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-05-08T20:54:06.093 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-packaging (20.3-1) ... 2024-05-08T20:54:06.219 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:54:06.345 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rsa (4.0-3) ... 2024-05-08T20:54:06.419 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-05-08T20:54:06.547 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-05-08T20:54:06.646 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-05-08T20:54:06.665 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-05-08T20:54:06.772 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-05-08T20:54:06.974 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-05-08T20:54:07.073 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-05-08T20:54:07.358 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T20:54:07.384 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-05-08T20:54:07.667 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-05-08T20:54:07.710 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-05-08T20:54:08.019 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librados2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:08.103 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-05-08T20:54:08.223 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-05-08T20:54:08.341 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librgw2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:08.467 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:08.514 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up socat (1.7.3.3-2) ... 2024-05-08T20:54:08.593 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:08.631 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:08.719 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-routes (2.4.1-2) ... 2024-05-08T20:54:08.941 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:54:09.012 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libradosstriper1 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:09.076 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-05-08T20:54:09.147 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-05-08T20:54:09.419 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-05-08T20:54:09.473 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librbd1 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:09.570 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-05-08T20:54:09.583 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:09.696 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-05-08T20:54:09.709 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:09.929 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:54:09.929 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:54:09.990 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-05-08T20:54:10.307 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:54:10.385 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs-dev (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:10.433 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-05-08T20:54:10.528 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rados (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:10.559 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-05-08T20:54:10.654 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephfs-top (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:10.789 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-05-08T20:54:10.928 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-05-08T20:54:11.237 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-05-08T20:54:11.555 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-05-08T20:54:11.693 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rbd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:11.706 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T20:54:11.852 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up rbd-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:11.974 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-05-08T20:54:11.978 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:12.104 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cephfs (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:12.224 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephfs-shell (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:12.300 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-05-08T20:54:12.342 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:12.626 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-05-08T20:54:12.894 INFO:teuthology.orchestra.run.smithi107.stdout:Adding group ceph....done 2024-05-08T20:54:13.010 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-05-08T20:54:13.253 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-05-08T20:54:13.287 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user ceph....done 2024-05-08T20:54:13.363 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-05-08T20:54:13.455 INFO:teuthology.orchestra.run.smithi107.stdout:Setting system user ceph properties....done 2024-05-08T20:54:13.477 INFO:teuthology.orchestra.run.smithi107.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T20:54:13.626 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T20:54:13.714 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-05-08T20:54:13.936 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T20:54:14.124 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-05-08T20:54:14.258 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-05-08T20:54:14.367 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephfs-mirror (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-05-08T20:54:14.612 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:54:14.612 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:54:14.735 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-05-08T20:54:15.043 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-test (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:15.044 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-05-08T20:54:15.169 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up radosgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:15.645 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:54:15.645 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:54:16.079 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-base (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:16.455 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T20:54:16.517 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:54:16.668 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-05-08T20:54:16.881 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mds (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:17.036 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-05-08T20:54:17.109 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:54:17.110 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:54:17.337 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-05-08T20:54:17.549 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:17.646 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-05-08T20:54:17.773 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-05-08T20:54:17.781 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:54:17.782 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:54:18.124 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-05-08T20:54:18.201 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-osd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:18.442 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-05-08T20:54:18.718 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:54:18.718 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:54:18.819 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-05-08T20:54:19.153 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-05-08T20:54:19.169 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:19.295 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:19.429 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mon (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:19.650 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:54:19.650 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:54:20.097 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:20.201 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-05-08T20:54:20.239 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:20.326 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-05-08T20:54:20.365 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:20.486 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-05-08T20:54:20.508 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-volume (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:20.612 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rsa (4.0-3) ... 2024-05-08T20:54:20.894 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-05-08T20:54:20.921 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-05-08T20:54:21.049 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-05-08T20:54:21.056 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-05-08T20:54:21.323 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-05-08T20:54:21.374 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-05-08T20:54:21.675 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T20:54:22.001 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-05-08T20:54:22.361 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librados2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:22.589 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-05-08T20:54:22.715 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librgw2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:22.841 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:22.993 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs2 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:23.119 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-routes (2.4.1-2) ... 2024-05-08T20:54:23.420 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libradosstriper1 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:23.529 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-05-08T20:54:23.848 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up librbd1 (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:23.999 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-modules-core (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:24.125 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:24.259 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-05-08T20:54:24.352 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:54:24.352 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T20:54:24.835 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libcephfs-dev (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:24.874 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:54:24.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-08T20:54:24.945 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-08T20:54:24.961 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rados (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:25.103 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-top (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:25.157 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-08T20:54:25.158 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-08T20:54:25.229 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-05-08T20:54:25.375 INFO:teuthology.orchestra.run.smithi107.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-05-08T20:54:25.375 INFO:teuthology.orchestra.run.smithi107.stdout:flex is already the newest version (2.6.4-6.2). 2024-05-08T20:54:25.375 INFO:teuthology.orchestra.run.smithi107.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-08T20:54:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-05-08T20:54:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-05-08T20:54:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-05-08T20:54:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-05-08T20:54:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: usb-modeswitch-data wpasupplicant 2024-05-08T20:54:25.379 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-08T20:54:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-05-08T20:54:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-05-08T20:54:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: libengine-pkcs11-openssl 2024-05-08T20:54:25.439 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-08T20:54:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-05-08T20:54:25.440 INFO:teuthology.orchestra.run.smithi107.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-05-08T20:54:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-05-08T20:54:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-05-08T20:54:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-05-08T20:54:25.441 INFO:teuthology.orchestra.run.smithi107.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-08T20:54:25.441 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-05-08T20:54:25.442 INFO:teuthology.orchestra.run.smithi107.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-05-08T20:54:25.506 INFO:teuthology.orchestra.run.smithi107.stdout:6 upgraded, 31 newly installed, 0 to remove and 272 not upgraded. 2024-05-08T20:54:25.506 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 25.3 MB of archives. 2024-05-08T20:54:25.507 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 79.9 MB of additional disk space will be used. 2024-05-08T20:54:25.507 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-05-08T20:54:25.670 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-05-08T20:54:25.671 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-05-08T20:54:25.671 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-05-08T20:54:25.677 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-05-08T20:54:25.678 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-05-08T20:54:25.701 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-05-08T20:54:25.701 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-05-08T20:54:25.704 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-05-08T20:54:25.705 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-05-08T20:54:25.705 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-05-08T20:54:25.711 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-05-08T20:54:25.712 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-05-08T20:54:25.714 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-05-08T20:54:25.714 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-05-08T20:54:25.734 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-05-08T20:54:25.734 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-05-08T20:54:25.742 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.18-0ubuntu0.20.04.1 [116 kB] 2024-05-08T20:54:25.744 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-05-08T20:54:25.750 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-05-08T20:54:25.750 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-05-08T20:54:25.764 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-05-08T20:54:25.764 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-05-08T20:54:25.772 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-05-08T20:54:25.782 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-05-08T20:54:25.797 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-05-08T20:54:25.801 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-05-08T20:54:25.801 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-05-08T20:54:25.801 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-05-08T20:54:25.801 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.18-0ubuntu0.20.04.1 [1,054 kB] 2024-05-08T20:54:25.810 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-05-08T20:54:25.812 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.18-0ubuntu0.20.04.1 [13.5 MB] 2024-05-08T20:54:25.927 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-05-08T20:54:25.927 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-05-08T20:54:26.006 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-05-08T20:54:26.006 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-05-08T20:54:26.007 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-05-08T20:54:26.158 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rbd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:26.284 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up rbd-fuse (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:26.402 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-rgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:26.405 INFO:teuthology.orchestra.run.smithi107.stdout:Preconfiguring packages ... 2024-05-08T20:54:26.553 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up python3-cephfs (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:26.598 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 25.3 MB in 1s (45.4 MB/s) 2024-05-08T20:54:26.679 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-shell (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:26.838 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-common (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:27.172 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153098 files and directories currently installed.) 2024-05-08T20:54:27.176 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-05-08T20:54:27.416 INFO:teuthology.orchestra.run.smithi195.stdout:Adding group ceph....done 2024-05-08T20:54:27.528 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-05-08T20:54:27.826 INFO:teuthology.orchestra.run.smithi195.stdout:Adding system user ceph....done 2024-05-08T20:54:28.019 INFO:teuthology.orchestra.run.smithi195.stdout:Setting system user ceph properties....done 2024-05-08T20:54:28.043 INFO:teuthology.orchestra.run.smithi195.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T20:54:28.194 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T20:54:28.497 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T20:54:28.618 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-05-08T20:54:29.307 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up cephfs-mirror (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:29.525 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:54:29.525 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-08T20:54:30.017 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-test (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:30.057 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153098 files and directories currently installed.) 2024-05-08T20:54:30.061 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-05-08T20:54:30.143 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up radosgw (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:30.193 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-05-08T20:54:30.591 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-05-08T20:54:30.627 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:54:30.627 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T20:54:30.738 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-05-08T20:54:31.067 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-05-08T20:54:31.095 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-base (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:31.459 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T20:54:31.524 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153098 files and directories currently installed.) 2024-05-08T20:54:31.529 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-05-08T20:54:31.662 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-05-08T20:54:31.913 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mds (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:32.076 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-05-08T20:54:32.163 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:54:32.163 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T20:54:32.209 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-05-08T20:54:32.607 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:32.838 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:54:32.838 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T20:54:33.300 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-osd (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:33.634 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-05-08T20:54:33.765 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-05-08T20:54:33.768 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:54:33.768 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T20:54:34.251 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:34.269 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-08T20:54:34.286 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-05-08T20:54:34.327 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-05-08T20:54:34.377 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:34.512 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mon (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:34.680 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package dump. 2024-05-08T20:54:34.699 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-05-08T20:54:34.738 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking dump (0.4b46-6) ... 2024-05-08T20:54:34.767 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:54:34.767 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T20:54:35.033 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package indent. 2024-05-08T20:54:35.051 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:54:35.091 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-05-08T20:54:35.315 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-cephadm (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:35.419 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-08T20:54:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-05-08T20:54:35.477 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-05-08T20:54:35.507 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:35.633 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-mgr-dashboard (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:35.801 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ceph-volume (18.2.2-1322-gd21e4f96-1focal) ... 2024-05-08T20:54:35.806 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-08T20:54:35.823 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-05-08T20:54:35.864 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-05-08T20:54:36.133 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-08T20:54:36.150 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-05-08T20:54:36.170 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-05-08T20:54:36.191 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:54:36.322 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-05-08T20:54:36.570 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-08T20:54:36.590 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:36.607 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-05-08T20:54:36.627 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:54:36.897 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-08T20:54:36.914 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:36.955 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:54:37.258 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-08T20:54:37.275 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:37.316 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:54:37.669 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-08T20:54:37.686 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-05-08T20:54:37.727 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-05-08T20:54:38.080 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-08T20:54:38.097 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-05-08T20:54:38.146 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-05-08T20:54:38.524 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-08T20:54:38.541 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../14-libpq5_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:54:38.582 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:39.472 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-08T20:54:39.494 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:39.509 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-05-08T20:54:39.746 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:54:40.106 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-08T20:54:40.123 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:40.129 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:54:40.131 DEBUG:teuthology.orchestra.run.smithi195:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-08T20:54:40.164 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:54:40.205 INFO:teuthology.orchestra.run.smithi195.stdout:Reading package lists... 2024-05-08T20:54:40.400 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-08T20:54:40.418 INFO:teuthology.orchestra.run.smithi195.stdout:Building dependency tree... 2024-05-08T20:54:40.419 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-05-08T20:54:40.419 INFO:teuthology.orchestra.run.smithi195.stdout:Reading state information... 2024-05-08T20:54:40.483 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-05-08T20:54:40.635 INFO:teuthology.orchestra.run.smithi195.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout:flex is already the newest version (2.6.4-6.2). 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-05-08T20:54:40.636 INFO:teuthology.orchestra.run.smithi195.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T20:54:40.637 INFO:teuthology.orchestra.run.smithi195.stdout:The following additional packages will be installed: 2024-05-08T20:54:40.637 INFO:teuthology.orchestra.run.smithi195.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-05-08T20:54:40.637 INFO:teuthology.orchestra.run.smithi195.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-05-08T20:54:40.638 INFO:teuthology.orchestra.run.smithi195.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-05-08T20:54:40.638 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-05-08T20:54:40.638 INFO:teuthology.orchestra.run.smithi195.stdout: usb-modeswitch-data wpasupplicant 2024-05-08T20:54:40.639 INFO:teuthology.orchestra.run.smithi195.stdout:Suggested packages: 2024-05-08T20:54:40.639 INFO:teuthology.orchestra.run.smithi195.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-05-08T20:54:40.639 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-05-08T20:54:40.639 INFO:teuthology.orchestra.run.smithi195.stdout: libengine-pkcs11-openssl 2024-05-08T20:54:40.705 INFO:teuthology.orchestra.run.smithi195.stdout:The following NEW packages will be installed: 2024-05-08T20:54:40.706 INFO:teuthology.orchestra.run.smithi195.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-05-08T20:54:40.706 INFO:teuthology.orchestra.run.smithi195.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-05-08T20:54:40.706 INFO:teuthology.orchestra.run.smithi195.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-05-08T20:54:40.706 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-05-08T20:54:40.706 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-05-08T20:54:40.707 INFO:teuthology.orchestra.run.smithi195.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-08T20:54:40.708 INFO:teuthology.orchestra.run.smithi195.stdout:The following packages will be upgraded: 2024-05-08T20:54:40.709 INFO:teuthology.orchestra.run.smithi195.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-05-08T20:54:40.896 INFO:teuthology.orchestra.run.smithi195.stdout:6 upgraded, 31 newly installed, 0 to remove and 272 not upgraded. 2024-05-08T20:54:40.896 INFO:teuthology.orchestra.run.smithi195.stdout:Need to get 25.3 MB of archives. 2024-05-08T20:54:40.897 INFO:teuthology.orchestra.run.smithi195.stdout:After this operation, 79.9 MB of additional disk space will be used. 2024-05-08T20:54:40.897 INFO:teuthology.orchestra.run.smithi195.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-05-08T20:54:40.986 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-08T20:54:41.004 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-05-08T20:54:41.045 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-05-08T20:54:41.415 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package modemmanager. 2024-05-08T20:54:41.434 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:41.484 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:54:41.531 INFO:teuthology.orchestra.run.smithi195.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-05-08T20:54:41.533 INFO:teuthology.orchestra.run.smithi195.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-05-08T20:54:41.534 INFO:teuthology.orchestra.run.smithi195.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-05-08T20:54:41.546 INFO:teuthology.orchestra.run.smithi195.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-05-08T20:54:41.549 INFO:teuthology.orchestra.run.smithi195.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-05-08T20:54:41.648 INFO:teuthology.orchestra.run.smithi195.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-05-08T20:54:41.650 INFO:teuthology.orchestra.run.smithi195.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-05-08T20:54:41.658 INFO:teuthology.orchestra.run.smithi195.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-05-08T20:54:41.662 INFO:teuthology.orchestra.run.smithi195.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-05-08T20:54:41.663 INFO:teuthology.orchestra.run.smithi195.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2024-05-08T20:54:41.830 INFO:teuthology.orchestra.run.smithi195.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-05-08T20:54:42.087 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package wpasupplicant. 2024-05-08T20:54:42.101 INFO:teuthology.orchestra.run.smithi195.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-05-08T20:54:42.106 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-05-08T20:54:42.145 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-05-08T20:54:42.230 INFO:teuthology.orchestra.run.smithi195.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-05-08T20:54:42.235 INFO:teuthology.orchestra.run.smithi195.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-05-08T20:54:42.329 INFO:teuthology.orchestra.run.smithi195.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2024-05-08T20:54:42.333 INFO:teuthology.orchestra.run.smithi195.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-05-08T20:54:42.416 INFO:teuthology.orchestra.run.smithi195.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.18-0ubuntu0.20.04.1 [116 kB] 2024-05-08T20:54:42.433 INFO:teuthology.orchestra.run.smithi195.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-05-08T20:54:42.502 INFO:teuthology.orchestra.run.smithi195.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-05-08T20:54:42.502 INFO:teuthology.orchestra.run.smithi195.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-05-08T20:54:42.589 INFO:teuthology.orchestra.run.smithi195.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-05-08T20:54:42.692 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package network-manager. 2024-05-08T20:54:42.708 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-05-08T20:54:42.752 INFO:teuthology.orchestra.run.smithi195.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-05-08T20:54:42.774 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-05-08T20:54:43.365 INFO:teuthology.orchestra.run.smithi195.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2024-05-08T20:54:43.465 INFO:teuthology.orchestra.run.smithi195.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-05-08T20:54:43.498 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ppp. 2024-05-08T20:54:43.518 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-05-08T20:54:43.553 INFO:teuthology.orchestra.run.smithi195.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-05-08T20:54:43.563 INFO:teuthology.orchestra.run.smithi195.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-05-08T20:54:43.564 INFO:teuthology.orchestra.run.smithi195.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-05-08T20:54:43.565 INFO:teuthology.orchestra.run.smithi195.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-05-08T20:54:43.566 INFO:teuthology.orchestra.run.smithi195.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.18-0ubuntu0.20.04.1 [1,054 kB] 2024-05-08T20:54:43.599 INFO:teuthology.orchestra.run.smithi195.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-05-08T20:54:43.603 INFO:teuthology.orchestra.run.smithi195.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.18-0ubuntu0.20.04.1 [13.5 MB] 2024-05-08T20:54:43.754 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-05-08T20:54:43.979 INFO:teuthology.orchestra.run.smithi195.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-05-08T20:54:44.095 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package pptp-linux. 2024-05-08T20:54:44.112 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-05-08T20:54:44.153 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-05-08T20:54:44.218 INFO:teuthology.orchestra.run.smithi195.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-05-08T20:54:44.306 INFO:teuthology.orchestra.run.smithi195.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-05-08T20:54:44.307 INFO:teuthology.orchestra.run.smithi195.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-05-08T20:54:44.439 INFO:teuthology.orchestra.run.smithi195.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-05-08T20:54:44.531 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-08T20:54:44.551 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-05-08T20:54:44.606 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-05-08T20:54:44.952 INFO:teuthology.orchestra.run.smithi195.stdout:Preconfiguring packages ... 2024-05-08T20:54:44.967 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-08T20:54:44.987 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-05-08T20:54:45.125 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-05-08T20:54:45.145 INFO:teuthology.orchestra.run.smithi195.stdout:Fetched 25.3 MB in 4s (6,630 kB/s) 2024-05-08T20:54:45.825 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153098 files and directories currently installed.) 2024-05-08T20:54:45.830 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-05-08T20:54:46.080 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-05-08T20:54:46.298 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-client-12. 2024-05-08T20:54:46.316 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../26-postgresql-client-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:54:46.356 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:46.936 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-common. 2024-05-08T20:54:46.955 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-05-08T20:54:47.051 INFO:teuthology.orchestra.run.smithi107.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-08T20:54:47.079 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-05-08T20:54:47.236 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-05-08T20:54:47.542 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-12. 2024-05-08T20:54:47.560 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../28-postgresql-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:54:47.604 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:48.651 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153098 files and directories currently installed.) 2024-05-08T20:54:48.656 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-05-08T20:54:48.811 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-05-08T20:54:49.186 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql. 2024-05-08T20:54:49.204 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-05-08T20:54:49.227 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-05-08T20:54:49.244 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-05-08T20:54:49.392 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-05-08T20:54:49.488 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-client. 2024-05-08T20:54:49.507 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-05-08T20:54:49.580 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-05-08T20:54:49.719 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-05-08T20:54:49.807 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-08T20:54:49.825 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-05-08T20:54:49.865 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-05-08T20:54:50.101 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-08T20:54:50.119 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-05-08T20:54:50.159 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-05-08T20:54:50.237 INFO:teuthology.orchestra.run.smithi195.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153098 files and directories currently installed.) 2024-05-08T20:54:50.241 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-05-08T20:54:50.374 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-05-08T20:54:50.562 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-08T20:54:50.579 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-05-08T20:54:50.631 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-05-08T20:54:50.819 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-05-08T20:54:50.967 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-05-08T20:54:51.176 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-05-08T20:54:51.213 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-05-08T20:54:51.477 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:51.578 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-05-08T20:54:51.688 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-05-08T20:54:51.814 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-05-08T20:54:52.213 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:54:52.214 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:54:52.691 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:53.015 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-05-08T20:54:53.145 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-05-08T20:54:53.584 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-08T20:54:53.680 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-05-08T20:54:53.691 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-08T20:54:53.708 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-05-08T20:54:53.749 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-05-08T20:54:53.806 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-05-08T20:54:53.932 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-05-08T20:54:54.111 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package dump. 2024-05-08T20:54:54.128 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-05-08T20:54:54.172 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking dump (0.4b46-6) ... 2024-05-08T20:54:54.498 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package indent. 2024-05-08T20:54:54.515 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:54:54.556 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-05-08T20:54:54.901 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-08T20:54:54.917 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-05-08T20:54:54.942 INFO:teuthology.orchestra.run.smithi107.stdout:Adding user postgres to group ssl-cert 2024-05-08T20:54:54.959 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-05-08T20:54:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:54:55.194 INFO:teuthology.orchestra.run.smithi107.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-08T20:54:55.304 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-08T20:54:55.320 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2024-05-08T20:54:55.395 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-05-08T20:54:55.438 INFO:teuthology.orchestra.run.smithi107.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-08T20:54:55.438 INFO:teuthology.orchestra.run.smithi107.stdout:Removing obsolete dictionary files: 2024-05-08T20:54:55.665 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-08T20:54:55.683 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-05-08T20:54:55.748 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:54:55.753 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-08T20:54:56.093 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-08T20:54:56.113 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:56.151 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:54:56.379 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-08T20:54:56.396 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:56.462 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:54:56.807 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-08T20:54:56.826 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:56.842 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-05-08T20:54:56.865 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:54:56.970 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-05-08T20:54:57.094 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-05-08T20:54:57.220 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-05-08T20:54:57.251 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-08T20:54:57.268 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2024-05-08T20:54:57.309 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2024-05-08T20:54:57.596 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-08T20:54:57.615 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-05-08T20:54:57.645 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-05-08T20:54:58.040 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-08T20:54:58.059 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../14-libpq5_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:54:58.172 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-05-08T20:54:58.324 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:58.409 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up dump (0.4b46-6) ... 2024-05-08T20:54:58.506 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-08T20:54:58.568 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:54:58.720 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-05-08T20:54:58.846 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-05-08T20:54:58.972 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-05-08T20:54:59.148 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-05-08T20:54:59.274 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:54:59.312 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-08T20:54:59.331 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:59.387 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:54:59.630 INFO:teuthology.orchestra.run.smithi107.stdout:Creating new PostgreSQL cluster 12/main ... 2024-05-08T20:54:59.654 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:This user must also own the server process. 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:The database cluster will be initialized with locale "en_US". 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:The default text search configuration will be set to "english". 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:54:59.715 INFO:teuthology.orchestra.run.smithi107.stdout:Data page checksums are disabled. 2024-05-08T20:54:59.716 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:54:59.716 INFO:teuthology.orchestra.run.smithi107.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-05-08T20:54:59.716 INFO:teuthology.orchestra.run.smithi107.stdout:creating subdirectories ... ok 2024-05-08T20:54:59.716 INFO:teuthology.orchestra.run.smithi107.stdout:selecting dynamic shared memory implementation ... posix 2024-05-08T20:54:59.735 INFO:teuthology.orchestra.run.smithi107.stdout:selecting default max_connections ... 100 2024-05-08T20:54:59.740 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-08T20:54:59.759 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:54:59.760 INFO:teuthology.orchestra.run.smithi107.stdout:selecting default shared_buffers ... 128MB 2024-05-08T20:54:59.771 INFO:teuthology.orchestra.run.smithi107.stdout:selecting default time zone ... Etc/UTC 2024-05-08T20:54:59.772 INFO:teuthology.orchestra.run.smithi107.stdout:creating configuration files ... ok 2024-05-08T20:54:59.798 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:54:59.885 INFO:teuthology.orchestra.run.smithi107.stdout:running bootstrap script ... ok 2024-05-08T20:55:00.074 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-08T20:55:00.094 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-05-08T20:55:00.142 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-05-08T20:55:00.437 INFO:teuthology.orchestra.run.smithi107.stdout:performing post-bootstrap initialization ... ok 2024-05-08T20:55:00.637 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-08T20:55:00.654 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-05-08T20:55:00.695 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-05-08T20:55:01.134 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package modemmanager. 2024-05-08T20:55:01.154 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-05-08T20:55:01.175 INFO:teuthology.orchestra.run.smithi107.stdout:syncing data to disk ... ok 2024-05-08T20:55:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:01.175 INFO:teuthology.orchestra.run.smithi107.stdout:Success. You can now start the database server using: 2024-05-08T20:55:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: pg_ctlcluster 12 main start 2024-05-08T20:55:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:01.210 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:55:01.498 INFO:teuthology.orchestra.run.smithi107.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-05-08T20:55:01.498 INFO:teuthology.orchestra.run.smithi107.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-05-08T20:55:01.590 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-08T20:55:01.865 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package wpasupplicant. 2024-05-08T20:55:01.882 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2024-05-08T20:55:01.923 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-05-08T20:55:02.436 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager. 2024-05-08T20:55:02.453 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-05-08T20:55:02.519 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-05-08T20:55:03.302 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package ppp. 2024-05-08T20:55:03.320 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-05-08T20:55:03.589 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-05-08T20:55:03.915 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package pptp-linux. 2024-05-08T20:55:03.934 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-05-08T20:55:03.990 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-05-08T20:55:04.544 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-08T20:55:04.563 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:55:04.564 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-05-08T20:55:04.620 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-05-08T20:55:04.689 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:55:04.799 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-05-08T20:55:04.955 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-08T20:55:04.966 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:55:04.973 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-05-08T20:55:05.033 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-05-08T20:55:05.093 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-05-08T20:55:05.260 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-05-08T20:55:05.334 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client-12. 2024-05-08T20:55:05.352 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../26-postgresql-client-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:55:05.426 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:55:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:05.988 INFO:teuthology.orchestra.run.smithi107.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-08T20:55:05.988 INFO:teuthology.orchestra.run.smithi107.stdout:which means they are currently configured by ifupdown: 2024-05-08T20:55:05.988 INFO:teuthology.orchestra.run.smithi107.stdout:- enp3s0f1 2024-05-08T20:55:05.988 INFO:teuthology.orchestra.run.smithi107.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-08T20:55:05.988 INFO:teuthology.orchestra.run.smithi107.stdout:remove their configuration from /etc/network/interfaces. 2024-05-08T20:55:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:06.005 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-common. 2024-05-08T20:55:06.024 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-05-08T20:55:06.078 INFO:teuthology.orchestra.run.smithi195.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-08T20:55:06.132 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-05-08T20:55:06.141 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-08T20:55:06.471 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-08T20:55:06.629 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-12. 2024-05-08T20:55:06.646 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../28-postgresql-12_12.18-0ubuntu0.20.04.1_amd64.deb ... 2024-05-08T20:55:06.690 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:55:07.019 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-08T20:55:07.497 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:55:07.631 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-05-08T20:55:07.816 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:55:07.942 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-05-08T20:55:08.068 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-05-08T20:55:08.193 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:55:08.313 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:55:08.374 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql. 2024-05-08T20:55:08.392 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-05-08T20:55:08.432 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-05-08T20:55:08.439 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:55:08.693 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-client. 2024-05-08T20:55:08.702 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:55:08.702 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:55:08.709 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-05-08T20:55:08.751 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-05-08T20:55:09.028 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-08T20:55:09.047 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-05-08T20:55:09.086 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-05-08T20:55:09.242 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-05-08T20:55:09.322 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-08T20:55:09.340 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-05-08T20:55:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-08T20:55:09.388 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-05-08T20:55:09.477 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-05-08T20:55:09.620 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-05-08T20:55:09.913 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-05-08T20:55:10.753 INFO:teuthology.orchestra.run.smithi195.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-08T20:55:10.768 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-05-08T20:55:10.819 INFO:teuthology.orchestra.run.smithi195.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-05-08T20:55:11.150 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-05-08T20:55:11.382 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-05-08T20:55:11.708 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libpq5:amd64 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:55:11.834 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-05-08T20:55:11.981 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-05-08T20:55:12.111 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2024-05-08T20:55:12.535 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:55:12.535 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-08T20:55:13.064 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:55:13.955 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-08T20:55:14.044 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-05-08T20:55:14.196 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-05-08T20:55:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-05-08T20:55:15.426 INFO:teuthology.orchestra.run.smithi195.stdout:Adding user postgres to group ssl-cert 2024-05-08T20:55:15.712 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:15.712 INFO:teuthology.orchestra.run.smithi195.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-08T20:55:15.957 INFO:teuthology.orchestra.run.smithi195.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-08T20:55:15.957 INFO:teuthology.orchestra.run.smithi195.stdout:Removing obsolete dictionary files: 2024-05-08T20:55:16.285 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-08T20:55:17.066 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-05-08T20:55:17.117 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-05-08T20:55:17.192 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-05-08T20:55:17.242 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-05-08T20:55:17.343 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-05-08T20:55:17.469 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-05-08T20:55:18.097 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:55:18.103 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:18.467 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-05-08T20:55:18.708 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up dump (0.4b46-6) ... 2024-05-08T20:55:18.806 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-08T20:55:18.868 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:55:19.020 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2024-05-08T20:55:19.154 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-05-08T20:55:19.280 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-05-08T20:55:19.481 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2024-05-08T20:55:19.607 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-12 (12.18-0ubuntu0.20.04.1) ... 2024-05-08T20:55:19.989 INFO:teuthology.orchestra.run.smithi195.stdout:Creating new PostgreSQL cluster 12/main ... 2024-05-08T20:55:20.010 INFO:teuthology.orchestra.run.smithi195.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:This user must also own the server process. 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:The database cluster will be initialized with locale "en_US". 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:The default text search configuration will be set to "english". 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:Data page checksums are disabled. 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:20.071 INFO:teuthology.orchestra.run.smithi195.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-05-08T20:55:20.072 INFO:teuthology.orchestra.run.smithi195.stdout:creating subdirectories ... ok 2024-05-08T20:55:20.072 INFO:teuthology.orchestra.run.smithi195.stdout:selecting dynamic shared memory implementation ... posix 2024-05-08T20:55:20.090 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default max_connections ... 100 2024-05-08T20:55:20.115 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default shared_buffers ... 128MB 2024-05-08T20:55:20.123 INFO:teuthology.orchestra.run.smithi195.stdout:selecting default time zone ... Etc/UTC 2024-05-08T20:55:20.124 INFO:teuthology.orchestra.run.smithi195.stdout:creating configuration files ... ok 2024-05-08T20:55:20.231 INFO:teuthology.orchestra.run.smithi195.stdout:running bootstrap script ... ok 2024-05-08T20:55:20.744 INFO:teuthology.orchestra.run.smithi195.stdout:performing post-bootstrap initialization ... ok 2024-05-08T20:55:21.736 INFO:teuthology.orchestra.run.smithi195.stdout:syncing data to disk ... ok 2024-05-08T20:55:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:21.736 INFO:teuthology.orchestra.run.smithi195.stdout:Success. You can now start the database server using: 2024-05-08T20:55:21.736 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: pg_ctlcluster 12 main start 2024-05-08T20:55:21.737 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:22.065 INFO:teuthology.orchestra.run.smithi195.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-05-08T20:55:22.065 INFO:teuthology.orchestra.run.smithi195.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-05-08T20:55:22.145 INFO:teuthology.orchestra.run.smithi195.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-08T20:55:25.164 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:55:25.290 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:55:25.416 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-05-08T20:55:25.617 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:55:25.743 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-05-08T20:55:25.903 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-05-08T20:55:26.634 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:26.635 INFO:teuthology.orchestra.run.smithi195.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-08T20:55:26.635 INFO:teuthology.orchestra.run.smithi195.stdout:which means they are currently configured by ifupdown: 2024-05-08T20:55:26.635 INFO:teuthology.orchestra.run.smithi195.stdout:- enp3s0f1 2024-05-08T20:55:26.635 INFO:teuthology.orchestra.run.smithi195.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-08T20:55:26.635 INFO:teuthology.orchestra.run.smithi195.stdout:remove their configuration from /etc/network/interfaces. 2024-05-08T20:55:26.635 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:26.795 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-08T20:55:27.110 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-08T20:55:27.654 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-08T20:55:28.198 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-05-08T20:55:28.358 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-05-08T20:55:28.500 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-05-08T20:55:28.659 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-05-08T20:55:28.785 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-05-08T20:55:28.911 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:55:29.062 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-05-08T20:55:29.188 INFO:teuthology.orchestra.run.smithi195.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-05-08T20:55:29.496 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:55:29.496 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-08T20:55:30.075 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-05-08T20:55:30.175 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-08T20:55:30.293 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-05-08T20:55:30.461 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-05-08T20:55:30.771 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-05-08T20:55:38.000 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-05-08T20:55:38.121 INFO:teuthology.orchestra.run.smithi195.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-05-08T20:55:38.967 INFO:teuthology.orchestra.run.smithi195.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T20:55:38.971 DEBUG:teuthology.parallel:result is None 2024-05-08T20:55:38.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:55:39.114 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2024-05-08T20:55:39.137 INFO:teuthology.orchestra.run.smithi107.stdout:18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:55:39.138 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:55:39.138 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322-gd21e4f96-1focal is installed. 2024-05-08T20:55:39.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:55:39.276 DEBUG:teuthology.orchestra.run.smithi195:> dpkg-query -W -f '${Version}' ceph 2024-05-08T20:55:39.301 INFO:teuthology.orchestra.run.smithi195.stdout:18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:55:39.301 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322-gd21e4f96-1focal 2024-05-08T20:55:39.301 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322-gd21e4f96-1focal is installed. 2024-05-08T20:55:39.303 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T20:55:39.303 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:39.303 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T20:55:39.320 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:39.320 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T20:55:39.336 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T20:55:39.336 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:39.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T20:55:39.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T20:55:39.368 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:39.368 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T20:55:39.395 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T20:55:39.406 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T20:55:39.406 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:39.406 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T20:55:39.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T20:55:39.440 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:39.440 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T20:55:39.455 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T20:55:39.511 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T20:55:39.511 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:39.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T20:55:39.526 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T20:55:39.537 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:39.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T20:55:39.552 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T20:55:39.609 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T20:55:39.694 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T20:55:39.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-05-08T20:55:39.696 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-05-08T20:55:39.712 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T20:55:39.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T20:55:39.714 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T20:55:39.726 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T20:55:39.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T20:55:39.769 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T20:55:39.794 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-08T20:55:39.794 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-08T20:55:39.794 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-08T20:55:39.794 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:39.794 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T20:55:39.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:39.882 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:39.882 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-08T20:55:39.889 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-08T20:55:39.975 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T20:55:39.976 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T20:55:39.976 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022', 'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7698022', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240508.150423-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240508.150423-reef', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2738, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'sleep_before_teardown': 0, 'subset': '17/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240508.150423-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'client.0': ['fs/maxentries']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_19:22:21', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T20:55:39.976 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T20:55:39.979 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T20:55:39.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T20:55:40.030 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T20:55:40.045 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:40.045 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T20:55:40.051 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T20:55:40.051 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-05-08T20:55:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-08 20:49:49.533132812 +0000 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-08 20:49:49.325137607 +0000 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-08 20:49:49.325137607 +0000 2024-05-08T20:55:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-08T20:55:40.099 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T20:55:40.110 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-08T20:55:40.111 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-08T20:55:40.111 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000413038 s, 1.2 MB/s 2024-05-08T20:55:40.112 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T20:55:40.120 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-05-08T20:55:40.170 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-08 20:49:49.937123500 +0000 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-08 20:49:49.733128202 +0000 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-08 20:49:49.733128202 +0000 2024-05-08T20:55:40.171 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-08T20:55:40.171 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T20:55:40.183 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-08T20:55:40.183 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-08T20:55:40.183 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000439157 s, 1.2 MB/s 2024-05-08T20:55:40.185 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T20:55:40.193 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-05-08T20:55:40.200 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-08 20:49:50.353113913 +0000 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-08 20:49:50.145118706 +0000 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-08 20:49:50.145118706 +0000 2024-05-08T20:55:40.201 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-08T20:55:40.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T20:55:40.258 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-08T20:55:40.258 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-08T20:55:40.258 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000407271 s, 1.3 MB/s 2024-05-08T20:55:40.259 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T20:55:40.267 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-05-08T20:55:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T20:55:40.274 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.274 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-05-08T20:55:40.274 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.274 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-08 20:49:50.789103863 +0000 2024-05-08T20:55:40.275 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-08 20:49:50.569108933 +0000 2024-05-08T20:55:40.275 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-08 20:49:50.569108933 +0000 2024-05-08T20:55:40.275 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-08T20:55:40.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T20:55:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-08T20:55:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-08T20:55:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000371055 s, 1.4 MB/s 2024-05-08T20:55:40.332 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T20:55:40.340 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:40.340 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:40.340 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T20:55:40.347 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T20:55:40.347 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-05-08T20:55:40.355 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T20:55:40.355 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.355 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 361 Links: 1 2024-05-08T20:55:40.355 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.356 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 20:49:52.280974246 +0000 2024-05-08T20:55:40.356 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 20:49:52.048979594 +0000 2024-05-08T20:55:40.356 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 20:49:52.048979594 +0000 2024-05-08T20:55:40.356 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T20:55:40.356 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T20:55:40.368 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T20:55:40.369 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T20:55:40.369 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000308333 s, 1.7 MB/s 2024-05-08T20:55:40.370 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T20:55:40.420 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 20:49:52.724964012 +0000 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 20:49:52.488969452 +0000 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 20:49:52.488969452 +0000 2024-05-08T20:55:40.428 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T20:55:40.429 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T20:55:40.439 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T20:55:40.439 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T20:55:40.439 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000269125 s, 1.9 MB/s 2024-05-08T20:55:40.440 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T20:55:40.448 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-05-08T20:55:40.453 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 20:49:53.152954147 +0000 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 20:49:52.920959494 +0000 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 20:49:52.920959494 +0000 2024-05-08T20:55:40.454 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T20:55:40.454 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T20:55:40.465 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T20:55:40.465 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T20:55:40.465 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000297896 s, 1.7 MB/s 2024-05-08T20:55:40.466 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T20:55:40.473 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-05-08 20:49:53.608943636 +0000 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-05-08 20:49:53.384948799 +0000 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-05-08 20:49:53.384948799 +0000 2024-05-08T20:55:40.527 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: - 2024-05-08T20:55:40.528 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T20:55:40.539 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-05-08T20:55:40.539 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-05-08T20:55:40.539 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000295349 s, 1.7 MB/s 2024-05-08T20:55:40.540 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T20:55:40.548 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:40.548 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T20:55:40.548 INFO:tasks.ceph:Generating config... 2024-05-08T20:55:40.550 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-08T20:55:40.550 INFO:tasks.ceph:[client] debug client = 20 2024-05-08T20:55:40.550 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T20:55:40.550 INFO:tasks.ceph:[client] pid file = 2024-05-08T20:55:40.550 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-08T20:55:40.550 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-08T20:55:40.550 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-08T20:55:40.550 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-08T20:55:40.550 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T20:55:40.551 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T20:55:40.552 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T20:55:40.553 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T20:55:40.553 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-08T20:55:40.553 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T20:55:40.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T20:55:40.593 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T20:55:40.610 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T20:55:40.696 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:55:40.712 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2024-05-08T20:55:40.713 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-08T20:55:40.714 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:40.714 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T20:55:40.719 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid 1fb7fa61-19f6-46b1-9f16-722373da360d 2024-05-08T20:55:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = pacific 2024-05-08T20:55:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2024-05-08T20:55:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 1fb7fa61-19f6-46b1-9f16-722373da360d 2024-05-08T20:55:40.811 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2024-05-08T20:55:40.804864+0000 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-05-08T20:55:40.804864+0000 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 16 (pacific) 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2024-05-08T20:55:40.812 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T20:55:40.813 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T20:55:40.819 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1fb7fa61-19f6-46b1-9f16-722373da360d... 2024-05-08T20:55:40.820 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T20:55:40.822 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T20:55:40.854 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-05-08T20:55:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-05-08T20:55:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T20:55:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-05-08T20:55:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T20:55:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T20:55:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.107,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 1fb7fa61-19f6-46b1-9f16-722373da360d 2024-05-08T20:55:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-05-08T20:55:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-05-08T20:55:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-05-08T20:55:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T20:55:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-05-08T20:55:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-05-08T20:55:40.864 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-08T20:55:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-08T20:55:40.867 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-05-08T20:55:40.867 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-05-08T20:55:40.867 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T20:55:40.867 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-05-08T20:55:40.867 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.868 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-05-08T20:55:40.869 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.107,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 1fb7fa61-19f6-46b1-9f16-722373da360d 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.870 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.871 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-05-08T20:55:40.872 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-05-08T20:55:40.873 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-05-08T20:55:40.874 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.875 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-05-08T20:55:40.876 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-05-08T20:55:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-05-08T20:55:40.878 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-05-08T20:55:40.879 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T20:55:40.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T20:55:40.962 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T20:55:40.962 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:40.962 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T20:55:40.969 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:40.969 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T20:55:40.976 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T20:55:40.976 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:40.976 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T20:55:40.976 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:55:41.000 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:55:41.000 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:41.050 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T20:55:41.050 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:41.051 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T20:55:41.051 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T20:55:41.077 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:55:41.077 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:41.084 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T20:55:41.084 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T20:55:41.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T20:55:41.134 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T20:55:41.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T20:55:41.186 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T20:55:41.233 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T20:55:41.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T20:55:41.283 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-08T20:55:41.286 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-08T20:55:41.344 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T20:55:41.393 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-08T20:55:41.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-08T20:55:41.407 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T20:55:41.458 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-08T20:55:41.461 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-08T20:55:41.471 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T20:55:41.514 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-08T20:55:41.516 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-08T20:55:41.578 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T20:55:41.579 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T20:55:41.623 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T20:55:41.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-08T20:55:41.719 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-08T20:55:41.733 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T20:55:41.775 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T20:55:41.787 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-08T20:55:41.825 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-08T20:55:41.838 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T20:55:41.838 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T20:55:41.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T20:55:41.854 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:41.855 INFO:tasks.ceph:role: osd.0 2024-05-08T20:55:41.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T20:55:41.855 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T20:55:42.366 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:42.366 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:42.367 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:42.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-08T20:55:42.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T20:55:42.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T20:55:42.463 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:42.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:42.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T20:55:42.474 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:42.474 INFO:tasks.ceph:role: osd.1 2024-05-08T20:55:42.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T20:55:42.474 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:42.992 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:42.993 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:42.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-08T20:55:42.994 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T20:55:43.064 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T20:55:43.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:43.075 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:43.076 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T20:55:43.087 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:43.087 INFO:tasks.ceph:role: osd.2 2024-05-08T20:55:43.087 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T20:55:43.087 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:43.522 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:43.523 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:43.523 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-08T20:55:43.524 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T20:55:43.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T20:55:43.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:43.584 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:43.584 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T20:55:43.594 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:43.594 INFO:tasks.ceph:role: osd.3 2024-05-08T20:55:43.594 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T20:55:43.594 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T20:55:44.142 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:44.142 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:44.142 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:44.142 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 2024-05-08T20:55:44.142 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:44.143 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:44.143 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:44.143 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:44.143 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:44.143 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:44.144 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-08T20:55:44.144 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T20:55:44.195 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T20:55:44.206 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:44.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:44.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:44.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:44.335+0000 7fca9bbbd880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T20:55:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:44.339+0000 7fca9bbbd880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T20:55:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:44.339+0000 7fca9bbbd880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:55:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:44.339+0000 7fca9bbbd880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:55:44.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:44.339+0000 7fca9bbbd880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T20:55:44.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:44.343+0000 7fca9bbbd880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T20:55:47.356 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T20:55:47.371 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:47.407+0000 7fc7d06f9880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:47.407+0000 7fc7d06f9880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:47.407+0000 7fc7d06f9880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:47.407+0000 7fc7d06f9880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:55:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:47.407+0000 7fc7d06f9880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T20:55:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:47.407+0000 7fc7d06f9880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T20:55:50.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T20:55:50.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:50.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:50.495+0000 7f7144daa880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T20:55:50.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:50.495+0000 7f7144daa880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T20:55:50.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:50.495+0000 7f7144daa880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:55:50.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:50.495+0000 7f7144daa880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:55:50.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:50.495+0000 7f7144daa880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T20:55:50.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:50.495+0000 7f7144daa880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T20:55:53.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T20:55:53.519 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:53.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:53.552+0000 7f247b6a0880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T20:55:53.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:53.552+0000 7f247b6a0880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T20:55:53.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:53.552+0000 7f247b6a0880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:55:53.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:53.552+0000 7f247b6a0880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:55:53.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:53.552+0000 7f247b6a0880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T20:55:53.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:55:53.552+0000 7f247b6a0880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T20:55:56.542 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T20:55:56.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T20:55:56.614 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:56.614 INFO:tasks.ceph:role: osd.4 2024-05-08T20:55:56.615 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T20:55:56.615 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:56.657 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:56.658 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:56.658 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:56.658 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:56.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-05-08T20:55:56.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T20:55:56.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T20:55:56.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:56.731 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:56.731 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T20:55:56.743 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:56.743 INFO:tasks.ceph:role: osd.5 2024-05-08T20:55:56.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T20:55:56.743 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T20:55:56.785 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:56.785 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:56.785 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:56.786 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:56.787 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-05-08T20:55:56.787 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T20:55:56.853 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T20:55:56.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:56.864 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:56.865 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T20:55:56.876 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:56.876 INFO:tasks.ceph:role: osd.6 2024-05-08T20:55:56.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T20:55:56.876 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T20:55:56.918 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:56.919 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:56.920 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-05-08T20:55:56.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T20:55:56.939 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T20:55:56.947 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:56.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:56.949 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T20:55:57.008 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T20:55:57.008 INFO:tasks.ceph:role: osd.7 2024-05-08T20:55:57.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T20:55:57.008 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T20:55:57.050 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T20:55:57.050 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T20:55:57.051 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T20:55:57.051 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 2024-05-08T20:55:57.051 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T20:55:57.051 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-05-08T20:55:57.051 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T20:55:57.052 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T20:55:57.052 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T20:55:57.052 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T20:55:57.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-05-08T20:55:57.053 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T20:55:57.073 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T20:55:57.127 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T20:55:57.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:55:57.128 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:55:57.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:55:57.212+0000 7f91b3f2a880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T20:55:57.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:55:57.212+0000 7f91b3f2a880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T20:55:57.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:55:57.212+0000 7f91b3f2a880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:55:57.219 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:55:57.212+0000 7f91b3f2a880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:55:57.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:55:57.212+0000 7f91b3f2a880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T20:55:57.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:55:57.216+0000 7f91b3f2a880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T20:56:00.242 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T20:56:00.259 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:56:00.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:00.340+0000 7f849d110880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T20:56:00.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:00.340+0000 7f849d110880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T20:56:00.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:00.340+0000 7f849d110880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:56:00.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:00.340+0000 7f849d110880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:56:00.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:00.340+0000 7f849d110880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T20:56:00.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:00.340+0000 7f849d110880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T20:56:03.350 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T20:56:03.367 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:56:03.411 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:03.404+0000 7f386bea6880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T20:56:03.411 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:03.404+0000 7f386bea6880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T20:56:03.411 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:03.404+0000 7f386bea6880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:56:03.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:03.404+0000 7f386bea6880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:56:03.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:03.404+0000 7f386bea6880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T20:56:03.412 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:03.408+0000 7f386bea6880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T20:56:06.390 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T20:56:06.448 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:56:06.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:06.484+0000 7ff91fec7880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T20:56:06.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:06.484+0000 7ff91fec7880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T20:56:06.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:06.484+0000 7ff91fec7880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:56:06.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:06.484+0000 7ff91fec7880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:56:06.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:06.484+0000 7ff91fec7880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T20:56:06.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:06.484+0000 7ff91fec7880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T20:56:09.462 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T20:56:09.480 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T20:56:09.480 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T20:56:09.497 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-08T20:56:09.507 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.507 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-08T20:56:09.566 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T20:56:09.576 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T20:56:09.590 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.590 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T20:56:09.644 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.644 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T20:56:09.659 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.660 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T20:56:09.676 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-08T20:56:09.692 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.692 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-08T20:56:09.705 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.705 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T20:56:09.762 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T20:56:09.774 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T20:56:09.784 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.784 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T20:56:09.843 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.843 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T20:56:09.850 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:09.850 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-08T20:56:09.901 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.901 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T20:56:09.908 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:09.908 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-08T20:56:09.957 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T20:56:09.958 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T20:56:09.960 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T20:56:09.972 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2024-05-08T20:56:09.972 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmKwHHBxAAYHNfk6N9y1n13clJ0htl1A== 2024-05-08T20:56:09.972 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-05-08T20:56:09.972 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmWUmiEBAAvBGgPKGntOTB1uKdikdhSg== 2024-05-08T20:56:09.972 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmxysvFxAArLOx5wHT4B+s/ARdGPZkcA== 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDQ5jtmFKIUFBAAIbn1v2MtJi9aoXLvfnpXQg== 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDT5jtmeqVgGBAAKrdzQJTQImyGegV6o44OQQ== 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-05-08T20:56:09.973 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDW5jtmPYqfHRAA+4B1GUzoqh9BJwQytBf/Rw== 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDZ5jtm/6g/IRAAu6jUgG7GF8bB3xstgWnzZw== 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmsR70ChAAX+SVGQyWzEEGH3P2+oUsSQ== 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtm3Q8nGxAAiJImWsE7Y8sl50pZlOZ0VA== 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtm955+HhAArHq9j+lAJbvSD3g8l9pGfA== 2024-05-08T20:56:09.974 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDd5jtm9ffqDBAASPtCAbnAy0CehNhi+4cw3g== 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDg5jtmFlhnFBAAmV1b9DcrKt1pwE8m6h2Ikg== 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDj5jtmleJhGBAAvNIP9rQ5JCn89L5idGNi7A== 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDm5jtmBfv9HBAAOq5ts5M+KBb51ePtsgDR6w== 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-05-08T20:56:09.975 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmHqzsJBAAlVFaK6OVoJ2PYL8V7YU5Qg== 2024-05-08T20:56:09.976 INFO:teuthology.orchestra.run.smithi195.stdout:[client.2] 2024-05-08T20:56:09.976 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmTuCgKhAApqwwSbdP6qkqhr0Dw0WSUw== 2024-05-08T20:56:09.976 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-05-08T20:56:09.976 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtmFkISLhAAyyW2w+D5TSoyjx3AtgPZ5A== 2024-05-08T20:56:09.976 INFO:teuthology.orchestra.run.smithi195.stdout:[client.3] 2024-05-08T20:56:09.976 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQDN5jtm/esNMRAA1RRTHAShFgaU8FG+IMr0FQ== 2024-05-08T20:56:09.977 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-05-08T20:56:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmKwHHBxAAYHNfk6N9y1n13clJ0htl1A== 2024-05-08T20:56:09.978 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-08T20:56:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmWUmiEBAAvBGgPKGntOTB1uKdikdhSg== 2024-05-08T20:56:09.978 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-08T20:56:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmxysvFxAArLOx5wHT4B+s/ARdGPZkcA== 2024-05-08T20:56:09.979 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-05-08T20:56:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDQ5jtmFKIUFBAAIbn1v2MtJi9aoXLvfnpXQg== 2024-05-08T20:56:09.979 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-05-08T20:56:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDT5jtmeqVgGBAAKrdzQJTQImyGegV6o44OQQ== 2024-05-08T20:56:09.979 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDW5jtmPYqfHRAA+4B1GUzoqh9BJwQytBf/Rw== 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDZ5jtm/6g/IRAAu6jUgG7GF8bB3xstgWnzZw== 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmsR70ChAAX+SVGQyWzEEGH3P2+oUsSQ== 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtm3Q8nGxAAiJImWsE7Y8sl50pZlOZ0VA== 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtm955+HhAArHq9j+lAJbvSD3g8l9pGfA== 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-05-08T20:56:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDd5jtm9ffqDBAASPtCAbnAy0CehNhi+4cw3g== 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDg5jtmFlhnFBAAmV1b9DcrKt1pwE8m6h2Ikg== 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDj5jtmleJhGBAAvNIP9rQ5JCn89L5idGNi7A== 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDm5jtmBfv9HBAAOq5ts5M+KBb51ePtsgDR6w== 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmHqzsJBAAlVFaK6OVoJ2PYL8V7YU5Qg== 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmTuCgKhAApqwwSbdP6qkqhr0Dw0WSUw== 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-05-08T20:56:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtmFkISLhAAyyW2w+D5TSoyjx3AtgPZ5A== 2024-05-08T20:56:09.982 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-05-08T20:56:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDN5jtm/esNMRAA1RRTHAShFgaU8FG+IMr0FQ== 2024-05-08T20:56:09.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:56:09.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:10.020 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:56:10.022 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:10.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.129 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.221 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.274 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.326 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.378 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.380 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:56:10.432 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T20:56:10.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.578 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-08T20:56:10.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.631 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.681 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.728 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.730 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.781 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T20:56:10.829 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:10.868 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:10.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:10.926 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:10.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:10.980 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:11.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:11.035 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T20:56:11.089 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T20:56:11.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T20:56:11.100 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:56:11.184 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T20:56:11.201 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T20:56:11.218 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:56:11.349 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T20:56:11.367 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T20:56:11.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T20:56:11.470 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T20:56:11.488 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:56:11.490 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T20:56:11.537 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T20:56:11.538 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T20:56:11.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T20:56:11.540 INFO:tasks.ceph.mon.a:Started 2024-05-08T20:56:11.540 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T20:56:11.540 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T20:56:11.543 INFO:tasks.ceph.mon.b:Started 2024-05-08T20:56:11.543 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T20:56:11.543 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T20:56:11.545 INFO:tasks.ceph.mon.c:Started 2024-05-08T20:56:11.546 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T20:56:11.546 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T20:56:11.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T20:56:11.548 INFO:tasks.ceph.mgr.y:Started 2024-05-08T20:56:11.548 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T20:56:11.549 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T20:56:11.551 INFO:tasks.ceph.mgr.x:Started 2024-05-08T20:56:11.551 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T20:56:11.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T20:56:11.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9ff013c700 1 Processor -- start 2024-05-08T20:56:11.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9ff013c700 1 -- start start 2024-05-08T20:56:11.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9ff013c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:11.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9ff013c700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80b2170 con 0x7f9fe80cb2e0 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9ff013c700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80cd2e0 con 0x7f9fe8159660 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9ff013c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80aeb00 con 0x7f9fe80b40d0 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fee6d9700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9fe80cb2e0 0x7f9fe80cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:49362/0 (socket says 172.21.15.107:49362) 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fee6d9700 1 -- 172.21.15.107:0/189607009 learned_addr learned my addr 172.21.15.107:0/189607009 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9feded8700 1 --1- 172.21.15.107:0/189607009 >> v1:172.21.15.195:6789/0 conn(0x7f9fe8159660 0x7f9fe80701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:53078/0 (socket says 172.21.15.107:53078) 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:11.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.652+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:56:11.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.852+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:11.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.852+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:11.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.852+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:11.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.852+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:11.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:11.852+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:56:12.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:12.256+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:12.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:12.256+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:12.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:12.256+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:12.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:12.256+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:12.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:12.256+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:56:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:13.060+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:13.060+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:13.060+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:13.060+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:13.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:13.060+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 msgr2=0x7f9fe806df00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.195:3300/0 conn(0x7f9fe80b40d0 0x7f9fe806df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 >> v1:172.21.15.195:6789/0 conn(0x7f9fe8159660 legacy=0x7f9fe80701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 >> v1:172.21.15.107:6789/0 conn(0x7f9fe80cb2e0 legacy=0x7f9fe80cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80aeb00 con 0x7f9fcc0062f0 2024-05-08T20:56:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc008e50 con 0x7f9fcc003790 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:14.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.652+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:14.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:56:14.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:14.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:14.856+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:15.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:15.256+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9fed6d7700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T20:56:16.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T20:56:16.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:16.056+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T20:56:17.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 msgr2=0x7f9fcc005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:17.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc003790 0x7f9fcc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 msgr2=0x7f9fcc008790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc0062f0 0x7f9fcc008790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fee6d9700 1 -- 172.21.15.107:0/189607009 reap_dead start 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc003bb0 0x7f9fcc0066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fcc007090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80ccf90 con 0x7f9fcc007660 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80aeb00 con 0x7f9fcc003bb0 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fdf7fe700 1 -- 172.21.15.107:0/189607009 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc008e50 con 0x7f9fcc006c10 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> v2:172.21.15.107:3300/0 conn(0x7f9fcc003bb0 0x7f9fcc0066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:17.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9fed6d7700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fcc007090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 msgr2=0x7f9fcc007090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fcc007090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 >> v1:172.21.15.195:6789/0 conn(0x7f9fcc007660 legacy=0x7f9fcc007b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feded8700 1 -- 172.21.15.107:0/189607009 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0084e0 con 0x7f9fcc003bb0 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feded8700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc003bb0 0x7f9fcc0066d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4007fd0 tx=0x7f9fe4005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af22433da852a91c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feced6700 1 -- 172.21.15.107:0/189607009 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4019070 con 0x7f9fcc003bb0 2024-05-08T20:56:17.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feced6700 1 -- 172.21.15.107:0/189607009 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe40125d0 con 0x7f9fcc003bb0 2024-05-08T20:56:17.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9feced6700 1 -- 172.21.15.107:0/189607009 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4012960 con 0x7f9fcc003bb0 2024-05-08T20:56:17.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 -- 172.21.15.107:0/189607009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc003bb0 msgr2=0x7f9fcc0066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc003bb0 0x7f9fcc0066d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4007fd0 tx=0x7f9fe4005ec0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 -- 172.21.15.107:0/189607009 shutdown_connections 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fcc007090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 --2- 172.21.15.107:0/189607009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc003bb0 0x7f9fcc0066d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 -- 172.21.15.107:0/189607009 >> 172.21.15.107:0/189607009 conn(0x7f9fe80b0cd0 msgr2=0x7f9fe80b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 -- 172.21.15.107:0/189607009 shutdown_connections 2024-05-08T20:56:17.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.656+0000 7f9ff013c700 1 -- 172.21.15.107:0/189607009 wait complete. 2024-05-08T20:56:17.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.660+0000 7f9ff013c700 1 Processor -- start 2024-05-08T20:56:17.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 -- start start 2024-05-08T20:56:17.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fcc003bb0 0x7f9fe8071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fe8143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc007660 0x7f9fe81439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80cd6c0 con 0x7f9fcc007660 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8147c60 con 0x7f9fcc003bb0 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8147050 con 0x7f9fcc006c10 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc007660 0x7f9fe81439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9feded8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fcc003bb0 0x7f9fe8071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fed6d7700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fe8143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9feded8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fcc003bb0 0x7f9fe8071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:40074/0 (socket says 172.21.15.107:40074) 2024-05-08T20:56:17.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9feded8700 1 -- 172.21.15.107:0/1271846410 learned_addr learned my addr 172.21.15.107:0/1271846410 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 -- 172.21.15.107:0/1271846410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 msgr2=0x7f9fe8143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fe8143470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 -- 172.21.15.107:0/1271846410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fcc003bb0 msgr2=0x7f9fe8071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fcc003bb0 0x7f9fe8071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 -- 172.21.15.107:0/1271846410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80cd2e0 con 0x7f9fcc007660 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fee6d9700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc007660 0x7f9fe81439b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8074410 tx=0x7f9fe000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00074e0 con 0x7f9fcc007660 2024-05-08T20:56:17.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0007660 con 0x7f9fcc007660 2024-05-08T20:56:17.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe8147330 con 0x7f9fcc007660 2024-05-08T20:56:17.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0007a10 con 0x7f9fcc007660 2024-05-08T20:56:17.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.664+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe81478f0 con 0x7f9fcc007660 2024-05-08T20:56:17.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.668+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9fe001c440 con 0x7f9fcc007660 2024-05-08T20:56:17.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.668+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9fe0012740 con 0x7f9fcc007660 2024-05-08T20:56:17.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.668+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8147df0 con 0x7f9fcc007660 2024-05-08T20:56:17.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.672+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f9fe0017070 con 0x7f9fcc007660 2024-05-08T20:56:17.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.740+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9fe80684b0 con 0x7f9fcc007660 2024-05-08T20:56:17.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9fde7fc700 1 -- 172.21.15.107:0/1271846410 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9fe0007b70 con 0x7f9fcc007660 2024-05-08T20:56:17.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc007660 msgr2=0x7f9fe81439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:17.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc007660 0x7f9fe81439b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8074410 tx=0x7f9fe000ca70 comp rx=0 tx=0).stop 2024-05-08T20:56:17.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 shutdown_connections 2024-05-08T20:56:17.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fcc007660 0x7f9fe81439b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9fcc006c10 0x7f9fe8143470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 --2- 172.21.15.107:0/1271846410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9fcc003bb0 0x7f9fe8071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:17.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 >> 172.21.15.107:0/1271846410 conn(0x7f9fe80b0cd0 msgr2=0x7f9fe8145ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:17.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 shutdown_connections 2024-05-08T20:56:17.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:17.748+0000 7f9ff013c700 1 -- 172.21.15.107:0/1271846410 wait complete. 2024-05-08T20:56:17.759 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-05-08T20:56:17.772 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T20:56:17.772 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T20:56:17.773 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:17.773 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T20:56:17.785 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:17.785 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T20:56:17.801 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:17.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T20:56:17.811 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:56:17.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T20:56:17.858 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:17.852+0000 7f90e0fac2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:56:17.863 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:17.856+0000 7fdeacc562c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:56:17.870 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:17.871 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T20:56:17.887 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:17.887 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T20:56:17.942 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:17.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T20:56:17.954 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T20:56:17.954 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T20:56:17.966 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new ec342ef5-51b0-4a13-952a-8afadec32813 0 2024-05-08T20:56:18.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.116+0000 7fcf8f59e700 1 Processor -- start 2024-05-08T20:56:18.121 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.116+0000 7fcf8f59e700 1 -- start start 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.116+0000 7fcf8f59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 0x7fcf9006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.116+0000 7fcf8f59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90071410 0x7fcf900b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9006b280 con 0x7fcf900ceba0 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900aef40 con 0x7fcf90159530 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9006ce00 con 0x7fcf90071410 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8ed9d700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90071410 0x7fcf900b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8e59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 0x7fcf9006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8e59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 0x7fcf9006ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.195:57548/0 (socket says 172.21.15.195:57548) 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8e59c700 1 -- 172.21.15.195:0/2642653260 learned_addr learned my addr 172.21.15.195:0/2642653260 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8dd9b700 1 --1- 172.21.15.195:0/2642653260 >> v1:172.21.15.107:6789/0 conn(0x7fcf900ceba0 0x7fcf90070d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.195:60550/0 (socket says 172.21.15.195:60550) 2024-05-08T20:56:18.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8ed9d700 1 -- 172.21.15.195:0/2642653260 >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 msgr2=0x7fcf9006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:18.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8ed9d700 1 --2- 172.21.15.195:0/2642653260 >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 0x7fcf9006ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8ed9d700 1 -- 172.21.15.195:0/2642653260 >> v1:172.21.15.107:6789/0 conn(0x7fcf900ceba0 legacy=0x7fcf90070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8d59a700 1 -- 172.21.15.195:0/2642653260 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756689066 0 0) 0x7fcf9006b280 con 0x7fcf900ceba0 2024-05-08T20:56:18.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8ed9d700 1 -- 172.21.15.195:0/2642653260 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9006d0e0 con 0x7fcf90071410 2024-05-08T20:56:18.126 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8e59c700 1 --2- 172.21.15.195:0/2642653260 >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 0x7fcf9006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8ed9d700 1 --2- 172.21.15.195:0/2642653260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90071410 0x7fcf900b24a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009d90 tx=0x7fcf8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a7e1fc0b2c94e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8d59a700 1 -- 172.21.15.195:0/2642653260 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8800e070 con 0x7fcf90071410 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8d59a700 1 -- 172.21.15.195:0/2642653260 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8800bb20 con 0x7fcf90071410 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8d59a700 1 -- 172.21.15.195:0/2642653260 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88012430 con 0x7fcf90071410 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- 172.21.15.195:0/2642653260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90071410 msgr2=0x7fcf900b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/2642653260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90071410 0x7fcf900b24a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009d90 tx=0x7fcf8800b330 comp rx=0 tx=0).stop 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- 172.21.15.195:0/2642653260 shutdown_connections 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/2642653260 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90071410 0x7fcf900b24a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/2642653260 >> v2:172.21.15.107:3300/0 conn(0x7fcf90159530 0x7fcf9006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- 172.21.15.195:0/2642653260 >> 172.21.15.195:0/2642653260 conn(0x7fcf900b15c0 msgr2=0x7fcf900b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- 172.21.15.195:0/2642653260 shutdown_connections 2024-05-08T20:56:18.127 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.120+0000 7fcf8f59e700 1 -- 172.21.15.195:0/2642653260 wait complete. 2024-05-08T20:56:18.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 Processor -- start 2024-05-08T20:56:18.128 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 -- start start 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf90071410 0x7fcf90153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf900ceba0 0x7fcf9015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90159530 0x7fcf900b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015bf50 con 0x7fcf90071410 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015c230 con 0x7fcf900ceba0 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9015c510 con 0x7fcf90159530 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8ed9d700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90159530 0x7fcf900b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf900ceba0 0x7fcf9015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8ed9d700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90159530 0x7fcf900b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:59802/0 (socket says 172.21.15.195:59802) 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8ed9d700 1 -- 172.21.15.195:0/845207484 learned_addr learned my addr 172.21.15.195:0/845207484 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8e59c700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf90071410 0x7fcf90153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.132 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 -- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90159530 msgr2=0x7fcf900b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90159530 0x7fcf900b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 -- 172.21.15.195:0/845207484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf90071410 msgr2=0x7fcf90153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf90071410 0x7fcf90153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 -- 172.21.15.195:0/845207484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8000a710 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8e59c700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf90071410 0x7fcf90153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8dd9b700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf900ceba0 0x7fcf9015b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c3e0 tx=0x7fcf8400c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400cea0 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84004ca0 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf88009a70 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.124+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84007310 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.128+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf901542f0 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.128+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcf840133c0 con 0x7fcf900ceba0 2024-05-08T20:56:18.133 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.128+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcf8401d730 con 0x7fcf900ceba0 2024-05-08T20:56:18.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.128+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf900672a0 con 0x7fcf900ceba0 2024-05-08T20:56:18.135 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.132+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fcf840138a0 con 0x7fcf900ceba0 2024-05-08T20:56:18.212 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.208+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ec342ef5-51b0-4a13-952a-8afadec32813", "id": 0} v 0) v1 -- 0x7fcf900b1b40 con 0x7fcf900ceba0 2024-05-08T20:56:18.218 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.212+0000 7fcf7effd700 1 -- 172.21.15.195:0/845207484 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec342ef5-51b0-4a13-952a-8afadec32813", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf84013a40 con 0x7fcf900ceba0 2024-05-08T20:56:18.218 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-05-08T20:56:18.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf900ceba0 msgr2=0x7fcf9015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf900ceba0 0x7fcf9015b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c3e0 tx=0x7fcf8400c6f0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 shutdown_connections 2024-05-08T20:56:18.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcf90159530 0x7fcf900b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf900ceba0 0x7fcf9015b600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.220 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 --2- 172.21.15.195:0/845207484 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf90071410 0x7fcf90153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 >> 172.21.15.195:0/845207484 conn(0x7fcf900b15c0 msgr2=0x7fcf9015d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 shutdown_connections 2024-05-08T20:56:18.221 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.216+0000 7fcf8f59e700 1 -- 172.21.15.195:0/845207484 wait complete. 2024-05-08T20:56:18.231 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 38e0c83f-826a-45e9-af25-6cdab0ac7cfa 1 2024-05-08T20:56:18.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 Processor -- start 2024-05-08T20:56:18.342 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 -- start start 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 0x7f469c0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c0cc230 0x7f469c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f469c15eb60 0x7f469c15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0cdeb0 con 0x7f469c15eb60 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0cbda0 con 0x7f469c15b000 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f46a0847700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0b0450 con 0x7f469c0cc230 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469ad9d700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 0x7f469c0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469a59c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c0cc230 0x7f469c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469ad9d700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 0x7f469c0b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44432/0 (socket says 172.21.15.195:44432) 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469ad9d700 1 -- 172.21.15.195:0/3858796197 learned_addr learned my addr 172.21.15.195:0/3858796197 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469b59e700 1 --2- 172.21.15.195:0/3858796197 >> v2:172.21.15.107:3300/0 conn(0x7f469c15eb60 0x7f469c15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.344 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469a59c700 1 -- 172.21.15.195:0/3858796197 >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 msgr2=0x7f469c0b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469a59c700 1 --2- 172.21.15.195:0/3858796197 >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 0x7f469c0b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469a59c700 1 -- 172.21.15.195:0/3858796197 >> v2:172.21.15.107:3300/0 conn(0x7f469c15eb60 msgr2=0x7f469c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469a59c700 1 --2- 172.21.15.195:0/3858796197 >> v2:172.21.15.107:3300/0 conn(0x7f469c15eb60 0x7f469c15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469a59c700 1 -- 172.21.15.195:0/3858796197 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0ce100 con 0x7f469c0cc230 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.336+0000 7f469ad9d700 1 --2- 172.21.15.195:0/3858796197 >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 0x7f469c0b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f469a59c700 1 --2- 172.21.15.195:0/3858796197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c0cc230 0x7f469c0cc690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f469c071660 tx=0x7f4690009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6356ab3910ad579e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f4699d9b700 1 -- 172.21.15.195:0/3858796197 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690011830 con 0x7f469c0cc230 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f4699d9b700 1 -- 172.21.15.195:0/3858796197 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690011990 con 0x7f469c0cc230 2024-05-08T20:56:18.345 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f4699d9b700 1 -- 172.21.15.195:0/3858796197 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690011d20 con 0x7f469c0cc230 2024-05-08T20:56:18.346 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 -- 172.21.15.195:0/3858796197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c0cc230 msgr2=0x7f469c0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.346 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 --2- 172.21.15.195:0/3858796197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c0cc230 0x7f469c0cc690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f469c071660 tx=0x7f4690009b30 comp rx=0 tx=0).stop 2024-05-08T20:56:18.346 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 -- 172.21.15.195:0/3858796197 shutdown_connections 2024-05-08T20:56:18.346 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 --2- 172.21.15.195:0/3858796197 >> v2:172.21.15.107:3300/0 conn(0x7f469c15eb60 0x7f469c15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 --2- 172.21.15.195:0/3858796197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c0cc230 0x7f469c0cc690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 --2- 172.21.15.195:0/3858796197 >> v2:172.21.15.195:3300/0 conn(0x7f469c15b000 0x7f469c0b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 -- 172.21.15.195:0/3858796197 >> 172.21.15.195:0/3858796197 conn(0x7f469c0b2970 msgr2=0x7f469c0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 -- 172.21.15.195:0/3858796197 shutdown_connections 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 -- 172.21.15.195:0/3858796197 wait complete. 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 Processor -- start 2024-05-08T20:56:18.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 -- start start 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 0x7f469c0c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.340+0000 7f46a0847700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c15b000 0x7f469c14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c15eb60 0x7f469c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15c700 con 0x7f469c15b000 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c15cfa0 con 0x7f469c0cc230 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0af470 con 0x7f469c15eb60 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 0x7f469c0c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.349 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469b59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c15eb60 0x7f469c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 0x7f469c0c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44442/0 (socket says 172.21.15.195:44442) 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 -- 172.21.15.195:0/3595556209 learned_addr learned my addr 172.21.15.195:0/3595556209 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469a59c700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c15b000 0x7f469c14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 -- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c15eb60 msgr2=0x7f469c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c15eb60 0x7f469c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 -- 172.21.15.195:0/3595556209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c15b000 msgr2=0x7f469c14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c15b000 0x7f469c14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 -- 172.21.15.195:0/3595556209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c009570 con 0x7f469c0cc230 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469b59e700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c15eb60 0x7f469c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f469ad9d700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 0x7f469c0c8b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f468c00ebe0 tx=0x7f468c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00c850 con 0x7f469c0cc230 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00c9b0 con 0x7f469c0cc230 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46900094b0 con 0x7f469c0cc230 2024-05-08T20:56:18.350 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00cd20 con 0x7f469c0cc230 2024-05-08T20:56:18.351 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c15cc30 con 0x7f469c0cc230 2024-05-08T20:56:18.351 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f468c004320 con 0x7f469c0cc230 2024-05-08T20:56:18.351 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f468c013820 con 0x7f469c0cc230 2024-05-08T20:56:18.351 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.344+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c0672a0 con 0x7f469c0cc230 2024-05-08T20:56:18.353 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.348+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f468c021060 con 0x7f469c0cc230 2024-05-08T20:56:18.425 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.420+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "38e0c83f-826a-45e9-af25-6cdab0ac7cfa", "id": 1} v 0) v1 -- 0x7f469c06f9e0 con 0x7f469c0cc230 2024-05-08T20:56:18.431 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46837fe700 1 -- 172.21.15.195:0/3595556209 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38e0c83f-826a-45e9-af25-6cdab0ac7cfa", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f468c017070 con 0x7f469c0cc230 2024-05-08T20:56:18.432 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-05-08T20:56:18.433 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 msgr2=0x7f469c0c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.433 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 0x7f469c0c8b40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f468c00ebe0 tx=0x7f468c00eef0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.433 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 shutdown_connections 2024-05-08T20:56:18.433 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f469c15eb60 0x7f469c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.434 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f469c15b000 0x7f469c14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.434 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 --2- 172.21.15.195:0/3595556209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f469c0cc230 0x7f469c0c8b40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.434 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 >> 172.21.15.195:0/3595556209 conn(0x7f469c0b2970 msgr2=0x7f469c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.434 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 shutdown_connections 2024-05-08T20:56:18.434 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.428+0000 7f46a0847700 1 -- 172.21.15.195:0/3595556209 wait complete. 2024-05-08T20:56:18.445 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:18.436+0000 7fdeacc562c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:56:18.446 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f 2 2024-05-08T20:56:18.485 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:18.480+0000 7f90e0fac2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:56:18.500 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:18.492+0000 7fdeacc562c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:56:18.540 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:18.536+0000 7f90e0fac2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:56:18.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.548+0000 7f189af2f700 1 Processor -- start 2024-05-08T20:56:18.555 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.548+0000 7f189af2f700 1 -- start start 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f189415b1c0 0x7f189406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189415ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1894071150 con 0x7f189406e9a0 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940713a0 con 0x7f189415b1c0 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1894071680 con 0x7f189406ee10 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189415ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.558 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189415ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:59830/0 (socket says 172.21.15.195:59830) 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 -- 172.21.15.195:0/4056842636 learned_addr learned my addr 172.21.15.195:0/4056842636 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f1899f2d700 1 --2- 172.21.15.195:0/4056842636 >> v2:172.21.15.107:3300/0 conn(0x7f189415b1c0 0x7f189406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 -- 172.21.15.195:0/4056842636 >> v2:172.21.15.107:3300/0 conn(0x7f189415b1c0 msgr2=0x7f189406d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 --2- 172.21.15.195:0/4056842636 >> v2:172.21.15.107:3300/0 conn(0x7f189415b1c0 0x7f189406d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 -- 172.21.15.195:0/4056842636 >> v1:172.21.15.107:6789/0 conn(0x7f189406e9a0 legacy=0x7f189406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 -- 172.21.15.195:0/4056842636 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894071960 con 0x7f189406ee10 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189a72e700 1 --2- 172.21.15.195:0/4056842636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189415ed90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f188c009e80 tx=0x7f188c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fd2406fa9e52fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f1898f2b700 1 -- 172.21.15.195:0/4056842636 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00e070 con 0x7f189406ee10 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f1898f2b700 1 -- 172.21.15.195:0/4056842636 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00b8d0 con 0x7f189406ee10 2024-05-08T20:56:18.559 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f1898f2b700 1 -- 172.21.15.195:0/4056842636 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00bc80 con 0x7f189406ee10 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- 172.21.15.195:0/4056842636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 msgr2=0x7f189415ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 --2- 172.21.15.195:0/4056842636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189415ed90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f188c009e80 tx=0x7f188c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- 172.21.15.195:0/4056842636 shutdown_connections 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 --2- 172.21.15.195:0/4056842636 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189415ed90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 --2- 172.21.15.195:0/4056842636 >> v2:172.21.15.107:3300/0 conn(0x7f189415b1c0 0x7f189406d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- 172.21.15.195:0/4056842636 >> 172.21.15.195:0/4056842636 conn(0x7f18940cfd20 msgr2=0x7f18940d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- 172.21.15.195:0/4056842636 shutdown_connections 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.552+0000 7f189af2f700 1 -- 172.21.15.195:0/4056842636 wait complete. 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 Processor -- start 2024-05-08T20:56:18.561 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 -- start start 2024-05-08T20:56:18.564 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189406e9a0 0x7f18941536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189409d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1894141540 0x7f18941419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18941421d0 con 0x7f189406e9a0 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894141f10 con 0x7f1894141540 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189415a630 con 0x7f189406ee10 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189972c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189409d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1894141540 0x7f18941419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f1899f2d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189406e9a0 0x7f18941536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189972c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189409d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:59834/0 (socket says 172.21.15.195:59834) 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189972c700 1 -- 172.21.15.195:0/4251250445 learned_addr learned my addr 172.21.15.195:0/4251250445 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 -- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 msgr2=0x7f189409d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.565 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189409d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 -- 172.21.15.195:0/4251250445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189406e9a0 msgr2=0x7f18941536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189406e9a0 0x7f18941536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 -- 172.21.15.195:0/4251250445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009b30 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189a72e700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1894141540 0x7f18941419d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f188c015000 tx=0x7f188c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c004800 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0092e0 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189415a910 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c01c680 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.556+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1894152ec0 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.560+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f188c01cae0 con 0x7f1894141540 2024-05-08T20:56:18.566 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.560+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f188c025c80 con 0x7f1894141540 2024-05-08T20:56:18.567 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.560+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18940672a0 con 0x7f1894141540 2024-05-08T20:56:18.568 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.564+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f188c020070 con 0x7f1894141540 2024-05-08T20:56:18.644 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.640+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f", "id": 2} v 0) v1 -- 0x7f189406ae90 con 0x7f1894141540 2024-05-08T20:56:18.653 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f188a7fc700 1 -- 172.21.15.195:0/4251250445 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f188c025450 con 0x7f1894141540 2024-05-08T20:56:18.653 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-05-08T20:56:18.654 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1894141540 msgr2=0x7f18941419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1894141540 0x7f18941419d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f188c015000 tx=0x7f188c004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 shutdown_connections 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1894141540 0x7f18941419d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f189406ee10 0x7f189409d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 --2- 172.21.15.195:0/4251250445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f189406e9a0 0x7f18941536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 >> 172.21.15.195:0/4251250445 conn(0x7f18940cfd20 msgr2=0x7f189415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 shutdown_connections 2024-05-08T20:56:18.655 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.648+0000 7f189af2f700 1 -- 172.21.15.195:0/4251250445 wait complete. 2024-05-08T20:56:18.657 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:18.648+0000 7fdeacc562c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:56:18.667 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new d95ef5ce-242c-4d1c-a03a-40b3cc523dbe 3 2024-05-08T20:56:18.703 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:18.696+0000 7f90e0fac2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:56:18.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.808+0000 7f603b086700 1 Processor -- start 2024-05-08T20:56:18.814 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.808+0000 7f603b086700 1 -- start start 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f603415b1c0 0x7f603406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f603406e9a0 0x7f603406a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6034071150 con 0x7f603406ee10 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60340713a0 con 0x7f603406e9a0 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6034071680 con 0x7f603415b1c0 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f603415b1c0 0x7f603406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f603415b1c0 0x7f603406d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44468/0 (socket says 172.21.15.195:44468) 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 -- 172.21.15.195:0/2863035708 learned_addr learned my addr 172.21.15.195:0/2863035708 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f6039883700 1 --2- 172.21.15.195:0/2863035708 >> v2:172.21.15.107:3300/0 conn(0x7f603406e9a0 0x7f603406a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.817 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 -- 172.21.15.195:0/2863035708 >> v2:172.21.15.107:3300/0 conn(0x7f603406e9a0 msgr2=0x7f603406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 --2- 172.21.15.195:0/2863035708 >> v2:172.21.15.107:3300/0 conn(0x7f603406e9a0 0x7f603406a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 -- 172.21.15.195:0/2863035708 >> v1:172.21.15.107:6789/0 conn(0x7f603406ee10 legacy=0x7f603415ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 -- 172.21.15.195:0/2863035708 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034071960 con 0x7f603415b1c0 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f6039883700 1 --2- 172.21.15.195:0/2863035708 >> v2:172.21.15.107:3300/0 conn(0x7f603406e9a0 0x7f603406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603a084700 1 --2- 172.21.15.195:0/2863035708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603415b1c0 0x7f603406d110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6030009910 tx=0x7f6030009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c497fe499b1277e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f6039082700 1 -- 172.21.15.195:0/2863035708 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603000ba20 con 0x7f603415b1c0 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f6039082700 1 -- 172.21.15.195:0/2863035708 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603000bb80 con 0x7f603415b1c0 2024-05-08T20:56:18.818 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f6039082700 1 -- 172.21.15.195:0/2863035708 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030009e60 con 0x7f603415b1c0 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- 172.21.15.195:0/2863035708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603415b1c0 msgr2=0x7f603406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 --2- 172.21.15.195:0/2863035708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603415b1c0 0x7f603406d110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6030009910 tx=0x7f6030009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- 172.21.15.195:0/2863035708 shutdown_connections 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 --2- 172.21.15.195:0/2863035708 >> v2:172.21.15.107:3300/0 conn(0x7f603406e9a0 0x7f603406a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 --2- 172.21.15.195:0/2863035708 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603415b1c0 0x7f603406d110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- 172.21.15.195:0/2863035708 >> 172.21.15.195:0/2863035708 conn(0x7f60340cfd20 msgr2=0x7f60340d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- 172.21.15.195:0/2863035708 shutdown_connections 2024-05-08T20:56:18.819 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.812+0000 7f603b086700 1 -- 172.21.15.195:0/2863035708 wait complete. 2024-05-08T20:56:18.820 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 Processor -- start 2024-05-08T20:56:18.820 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- start start 2024-05-08T20:56:18.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 0x7f6034150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603406ee10 0x7f60341f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 0x7f6034158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:18.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341510e0 con 0x7f603406ee10 2024-05-08T20:56:18.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341f79c0 con 0x7f603414eca0 2024-05-08T20:56:18.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603414e010 con 0x7f603406e9a0 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 0x7f6034150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a885700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 0x7f6034158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a885700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 0x7f6034158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44476/0 (socket says 172.21.15.195:44476) 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 0x7f6034150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:59846/0 (socket says 172.21.15.195:59846) 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a885700 1 -- 172.21.15.195:0/2288343841 learned_addr learned my addr 172.21.15.195:0/2288343841 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f6039883700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603406ee10 0x7f60341f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 -- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 msgr2=0x7f6034158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 0x7f6034158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 -- 172.21.15.195:0/2288343841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603406ee10 msgr2=0x7f60341f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603406ee10 0x7f60341f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 -- 172.21.15.195:0/2288343841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009570 con 0x7f603406e9a0 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f6039883700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603406ee10 0x7f60341f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a885700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 0x7f6034158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603a084700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 0x7f6034150a60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6030016000 tx=0x7f6030004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030004500 con 0x7f603406e9a0 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300036c0 con 0x7f603406e9a0 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030003a70 con 0x7f603406e9a0 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60340b2f70 con 0x7f603406e9a0 2024-05-08T20:56:18.824 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60340b3530 con 0x7f603406e9a0 2024-05-08T20:56:18.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6030025430 con 0x7f603406e9a0 2024-05-08T20:56:18.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6030020030 con 0x7f603406e9a0 2024-05-08T20:56:18.825 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.816+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60340672a0 con 0x7f603406e9a0 2024-05-08T20:56:18.828 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.824+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f603002a060 con 0x7f603406e9a0 2024-05-08T20:56:18.866 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:18.856+0000 7fdeacc562c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:56:18.901 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.896+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d95ef5ce-242c-4d1c-a03a-40b3cc523dbe", "id": 3} v 0) v1 -- 0x7f603406ae90 con 0x7f603406e9a0 2024-05-08T20:56:18.909 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f602affd700 1 -- 172.21.15.195:0/2288343841 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d95ef5ce-242c-4d1c-a03a-40b3cc523dbe", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6030015020 con 0x7f603406e9a0 2024-05-08T20:56:18.909 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-05-08T20:56:18.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 msgr2=0x7f6034150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:18.910 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 0x7f6034150a60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6030016000 tx=0x7f6030004770 comp rx=0 tx=0).stop 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 shutdown_connections 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f603414eca0 0x7f6034158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f603406ee10 0x7f60341f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 --2- 172.21.15.195:0/2288343841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f603406e9a0 0x7f6034150a60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 >> 172.21.15.195:0/2288343841 conn(0x7f60340cfd20 msgr2=0x7f603415d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 shutdown_connections 2024-05-08T20:56:18.911 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:18.904+0000 7f603b086700 1 -- 172.21.15.195:0/2288343841 wait complete. 2024-05-08T20:56:18.917 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:18.908+0000 7fdeacc562c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:56:18.920 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:18.916+0000 7f90e0fac2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:56:18.926 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new dfe14b6e-bdcd-4337-a710-c5a87fdde46a 4 2024-05-08T20:56:18.972 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:18.968+0000 7f90e0fac2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:56:19.034 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.028+0000 7f6ad29bd700 1 Processor -- start 2024-05-08T20:56:19.034 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.028+0000 7f6ad29bd700 1 -- start start 2024-05-08T20:56:19.035 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6acc13cda0 0x7f6acc06c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc0b3380 con 0x7f6acc15b060 2024-05-08T20:56:19.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc0b3660 con 0x7f6acc13d180 2024-05-08T20:56:19.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc15b6a0 con 0x7f6acc13cda0 2024-05-08T20:56:19.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acb7fe700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f6acc13d180 0x7f6acc15a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:37076/0 (socket says 172.21.15.195:37076) 2024-05-08T20:56:19.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acb7fe700 1 -- 172.21.15.195:0/3096759769 learned_addr learned my addr 172.21.15.195:0/3096759769 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-05-08T20:56:19.036 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 --2- 172.21.15.195:0/3096759769 >> v2:172.21.15.107:3300/0 conn(0x7f6acc13cda0 0x7f6acc06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754537346 0 0) 0x7f6acc0b3660 con 0x7f6acc13d180 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab40035d0 con 0x7f6acc13d180 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727477598 0 0) 0x7f6ab40035d0 con 0x7f6acc13d180 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 >> v2:172.21.15.107:3300/0 conn(0x7f6acc13cda0 msgr2=0x7f6acc06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 --2- 172.21.15.195:0/3096759769 >> v2:172.21.15.107:3300/0 conn(0x7f6acc13cda0 0x7f6acc06c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 >> v1:172.21.15.107:6789/0 conn(0x7f6acc15b060 legacy=0x7f6acc0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 --> v1:172.21.15.195:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0b3940 con 0x7f6acc13d180 2024-05-08T20:56:19.038 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 <== mon.1 v1:172.21.15.195:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7f6ac0001670 con 0x7f6acc13d180 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 --2- 172.21.15.195:0/3096759769 >> v2:172.21.15.107:3300/0 conn(0x7f6acc13cda0 0x7f6acc06c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 >> v1:172.21.15.195:6789/0 conn(0x7f6acc13d180 legacy=0x7f6acc15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6ab4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ab4004870 0x7f6ab4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ab4005230 0x7f6ab400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc15b6a0 con 0x7f6ab4005230 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab400c0d0 con 0x7f6ab4003a20 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab400c290 con 0x7f6ab4004870 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acb7fe700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ab4004870 0x7f6ab4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6ab4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad0f5a700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ab4005230 0x7f6ab400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 -- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ab4004870 msgr2=0x7f6ab4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ab4004870 0x7f6ab4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.039 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 -- 172.21.15.195:0/3096759769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ab4005230 msgr2=0x7f6ab400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ab4005230 0x7f6ab400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 -- 172.21.15.195:0/3096759769 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40035d0 con 0x7f6ab4003a20 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad0f5a700 1 -- 172.21.15.195:0/3096759769 reap_dead start 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acbfff700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6ab4003e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d40 tx=0x7f6ab40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd7494afec058d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc009e90 con 0x7f6ab4003a20 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc00e9a0 con 0x7f6ab4003a20 2024-05-08T20:56:19.040 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6acaffd700 1 -- 172.21.15.195:0/3096759769 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00ed50 con 0x7f6ab4003a20 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 msgr2=0x7f6ab4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6ab4003e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d40 tx=0x7f6ab40058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3096759769 shutdown_connections 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 --2- 172.21.15.195:0/3096759769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6ab4003e40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3096759769 >> 172.21.15.195:0/3096759769 conn(0x7f6acc06a360 msgr2=0x7f6acc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3096759769 shutdown_connections 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.032+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3096759769 wait complete. 2024-05-08T20:56:19.041 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 Processor -- start 2024-05-08T20:56:19.042 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 -- start start 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6acc154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 0x7f6acc1390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6acc139630 0x7f6acc1f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0aea40 con 0x7f6acc139630 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0aed20 con 0x7f6ab4003a20 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0af000 con 0x7f6acc1f5100 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 0x7f6acc1390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6acc154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 0x7f6acc1390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:59854/0 (socket says 172.21.15.195:59854) 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 -- 172.21.15.195:0/3756047047 learned_addr learned my addr 172.21.15.195:0/3756047047 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad0f5a700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6acc139630 0x7f6acc1f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.044 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 -- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 msgr2=0x7f6acc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6acc154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 -- 172.21.15.195:0/3756047047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6acc139630 msgr2=0x7f6acc1f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6acc139630 0x7f6acc1f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 -- 172.21.15.195:0/3756047047 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0af2e0 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6acb7fe700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 0x7f6acc1390f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00072a0 tx=0x7f6ac00075b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00014e0 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac000f660 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc0af5c0 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000fa30 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc155420 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6ac001d460 con 0x7f6acc1f5100 2024-05-08T20:56:19.045 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.036+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6ac00139a0 con 0x7f6acc1f5100 2024-05-08T20:56:19.046 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.040+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc0af800 con 0x7f6acc1f5100 2024-05-08T20:56:19.048 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.044+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6acc0af800 con 0x7f6acc1f5100 2024-05-08T20:56:19.098 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:19.092+0000 7fdeacc562c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:56:19.124 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.120+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dfe14b6e-bdcd-4337-a710-c5a87fdde46a", "id": 4} v 0) v1 -- 0x7f6acc0684b0 con 0x7f6acc1f5100 2024-05-08T20:56:19.134 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ac8ff9700 1 -- 172.21.15.195:0/3756047047 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfe14b6e-bdcd-4337-a710-c5a87fdde46a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6ac0013d50 con 0x7f6acc1f5100 2024-05-08T20:56:19.134 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-05-08T20:56:19.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 msgr2=0x7f6acc1390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 0x7f6acc1390f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6ac00072a0 tx=0x7f6ac00075b0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 shutdown_connections 2024-05-08T20:56:19.136 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6acc139630 0x7f6acc1f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6acc1f5100 0x7f6acc1390f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 --2- 172.21.15.195:0/3756047047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ab4003a20 0x7f6acc154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 >> 172.21.15.195:0/3756047047 conn(0x7f6acc06a360 msgr2=0x7f6acc06c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 shutdown_connections 2024-05-08T20:56:19.137 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.128+0000 7f6ad29bd700 1 -- 172.21.15.195:0/3756047047 wait complete. 2024-05-08T20:56:19.147 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new a13767bb-b37f-4e64-bb67-78baed813ac8 5 2024-05-08T20:56:19.163 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:19.156+0000 7fdeacc562c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:56:19.164 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:19.160+0000 7f90e0fac2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:56:19.227 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:19.220+0000 7fdeacc562c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:56:19.231 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:19.224+0000 7f90e0fac2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:56:19.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.252+0000 7f96df59e700 1 Processor -- start 2024-05-08T20:56:19.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.252+0000 7f96df59e700 1 -- start start 2024-05-08T20:56:19.261 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f96e015d670 0x7f96e00d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.261 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b40f0 0x7f96e00b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00ce440 con 0x7f96e00b63c0 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00d3b50 con 0x7f96e015d670 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00d3e30 con 0x7f96e00b40f0 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96de59c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f96e015d670 0x7f96e00d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96ded9d700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f96e00b63c0 0x7f96e00ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:37080/0 (socket says 172.21.15.195:37080) 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96ded9d700 1 -- 172.21.15.195:0/3139953835 learned_addr learned my addr 172.21.15.195:0/3139953835 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96ddd9b700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b40f0 0x7f96e00b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96de59c700 1 -- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b40f0 msgr2=0x7f96e00b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96de59c700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b40f0 0x7f96e00b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96de59c700 1 -- 172.21.15.195:0/3139953835 >> v1:172.21.15.195:6789/0 conn(0x7f96e00b63c0 legacy=0x7f96e00ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96de59c700 1 -- 172.21.15.195:0/3139953835 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00ce0d0 con 0x7f96e015d670 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96ddd9b700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b40f0 0x7f96e00b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:19.262 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96de59c700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00d0e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009850 tx=0x7f96d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb67a33834b714e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96dd59a700 1 -- 172.21.15.195:0/3139953835 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011830 con 0x7f96e015d670 2024-05-08T20:56:19.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96dd59a700 1 -- 172.21.15.195:0/3139953835 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0011990 con 0x7f96e015d670 2024-05-08T20:56:19.263 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96dd59a700 1 -- 172.21.15.195:0/3139953835 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011d40 con 0x7f96e015d670 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 msgr2=0x7f96e00d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00d0e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009850 tx=0x7f96d0009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- 172.21.15.195:0/3139953835 shutdown_connections 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b40f0 0x7f96e00b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 --2- 172.21.15.195:0/3139953835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00d0e10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- 172.21.15.195:0/3139953835 >> 172.21.15.195:0/3139953835 conn(0x7f96e00d3030 msgr2=0x7f96e00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- 172.21.15.195:0/3139953835 shutdown_connections 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.256+0000 7f96df59e700 1 -- 172.21.15.195:0/3139953835 wait complete. 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 Processor -- start 2024-05-08T20:56:19.264 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- start start 2024-05-08T20:56:19.266 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96e00b40f0 0x7f96e01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b63c0 0x7f96e00b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015ff70 con 0x7f96e00b40f0 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015f360 con 0x7f96e015d670 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e015f640 con 0x7f96e00b63c0 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ddd9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b63c0 0x7f96e00b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44516/0 (socket says 172.21.15.195:44516) 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 -- 172.21.15.195:0/1945382316 learned_addr learned my addr 172.21.15.195:0/1945382316 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96de59c700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96e00b40f0 0x7f96e01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 -- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b63c0 msgr2=0x7f96e00b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b63c0 0x7f96e00b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.267 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 -- 172.21.15.195:0/1945382316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96e00b40f0 msgr2=0x7f96e01515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96e00b40f0 0x7f96e01515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 -- 172.21.15.195:0/1945382316 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d40094b0 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ded9d700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00b87a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96d800ca80 tx=0x7f96d800cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8007480 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80075e0 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00094b0 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8007950 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e015fc00 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f96d801c440 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f96d801cc70 con 0x7f96e015d670 2024-05-08T20:56:19.268 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.260+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00c7390 con 0x7f96e015d670 2024-05-08T20:56:19.269 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.264+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f96d8021060 con 0x7f96e015d670 2024-05-08T20:56:19.295 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:19.288+0000 7f90e0fac2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:56:19.347 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.340+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a13767bb-b37f-4e64-bb67-78baed813ac8", "id": 5} v 0) v1 -- 0x7f96e00672a0 con 0x7f96e015d670 2024-05-08T20:56:19.355 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.348+0000 7f96ceffd700 1 -- 172.21.15.195:0/1945382316 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a13767bb-b37f-4e64-bb67-78baed813ac8", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96d8017070 con 0x7f96e015d670 2024-05-08T20:56:19.356 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-05-08T20:56:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 msgr2=0x7f96e00b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.357 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00b87a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96d800ca80 tx=0x7f96d800cab0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 shutdown_connections 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96e015d670 0x7f96e00b87a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96e00b63c0 0x7f96e00b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 --2- 172.21.15.195:0/1945382316 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96e00b40f0 0x7f96e01515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 >> 172.21.15.195:0/1945382316 conn(0x7f96e00d3030 msgr2=0x7f96e00cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 shutdown_connections 2024-05-08T20:56:19.358 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.352+0000 7f96df59e700 1 -- 172.21.15.195:0/1945382316 wait complete. 2024-05-08T20:56:19.372 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 2fdc75a4-710f-4128-88e4-5a342a60985e 6 2024-05-08T20:56:19.484 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5f31e700 1 Processor -- start 2024-05-08T20:56:19.485 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5f31e700 1 -- start start 2024-05-08T20:56:19.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5f31e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a580d1e90 0x7f7a580d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5f31e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a580b66d0 con 0x7f7a58160a30 2024-05-08T20:56:19.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5f31e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a580d11c0 con 0x7f7a580d3c50 2024-05-08T20:56:19.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5f31e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a580d14a0 con 0x7f7a580d1e90 2024-05-08T20:56:19.487 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5c8b9700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f7a580d3c50 0x7f7a580b6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:37086/0 (socket says 172.21.15.195:37086) 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5c8b9700 1 -- 172.21.15.195:0/2113486917 learned_addr learned my addr 172.21.15.195:0/2113486917 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5d8bb700 1 --2- 172.21.15.195:0/2113486917 >> v2:172.21.15.195:3300/0 conn(0x7f7a580d1e90 0x7f7a580d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828605154 0 0) 0x7f7a580d11c0 con 0x7f7a580d3c50 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a440035d0 con 0x7f7a580d3c50 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086880665 0 0) 0x7f7a580b66d0 con 0x7f7a58160a30 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a580d11c0 con 0x7f7a58160a30 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5d8bb700 1 -- 172.21.15.195:0/2113486917 >> v1:172.21.15.195:6789/0 conn(0x7f7a580d3c50 legacy=0x7f7a580b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 <== mon.1 v1:172.21.15.195:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750448711 0 0) 0x7f7a440035d0 con 0x7f7a580d3c50 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5d8bb700 1 -- 172.21.15.195:0/2113486917 >> v1:172.21.15.107:6789/0 conn(0x7f7a58160a30 legacy=0x7f7a580d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5d8bb700 1 -- 172.21.15.195:0/2113486917 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a580b6080 con 0x7f7a580d1e90 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a5d8bb700 1 --2- 172.21.15.195:0/2113486917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a580d0480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d480e3db64b07b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.480+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000e070 con 0x7f7a580d1e90 2024-05-08T20:56:19.488 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5000bb20 con 0x7f7a580d1e90 2024-05-08T20:56:19.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a4ffff700 1 -- 172.21.15.195:0/2113486917 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000be90 con 0x7f7a580d1e90 2024-05-08T20:56:19.489 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 -- 172.21.15.195:0/2113486917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 msgr2=0x7f7a580d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 --2- 172.21.15.195:0/2113486917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a580d0480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 -- 172.21.15.195:0/2113486917 shutdown_connections 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 --2- 172.21.15.195:0/2113486917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a580d0480 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 -- 172.21.15.195:0/2113486917 >> 172.21.15.195:0/2113486917 conn(0x7f7a5809c500 msgr2=0x7f7a580d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 -- 172.21.15.195:0/2113486917 shutdown_connections 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 -- 172.21.15.195:0/2113486917 wait complete. 2024-05-08T20:56:19.490 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 Processor -- start 2024-05-08T20:56:19.491 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.484+0000 7f7a5f31e700 1 -- start start 2024-05-08T20:56:19.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a58150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a580d3c50 0x7f7a5809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a58160a30 0x7f7a5809e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5809cf70 con 0x7f7a58160a30 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5809d810 con 0x7f7a580d1e90 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a581f39a0 con 0x7f7a580d3c50 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5d0ba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a58150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5d0ba700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a58150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44534/0 (socket says 172.21.15.195:44534) 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a580d3c50 0x7f7a5809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5d0ba700 1 -- 172.21.15.195:0/183274903 learned_addr learned my addr 172.21.15.195:0/183274903 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5d8bb700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a58160a30 0x7f7a5809e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 -- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 msgr2=0x7f7a58150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a58150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 -- 172.21.15.195:0/183274903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a58160a30 msgr2=0x7f7a5809e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.494 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a58160a30 0x7f7a5809e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 -- 172.21.15.195:0/183274903 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50009a70 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5d0ba700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a58150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5c8b9700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a580d3c50 0x7f7a5809dca0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c430 tx=0x7f7a4800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48005b90 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48005cf0 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48007310 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5809d1c0 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a58150b50 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7a48012400 con 0x7f7a580d3c50 2024-05-08T20:56:19.495 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f7a48012ca0 con 0x7f7a580d3c50 2024-05-08T20:56:19.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.488+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a580684b0 con 0x7f7a580d3c50 2024-05-08T20:56:19.496 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.492+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7a48012e60 con 0x7f7a580d3c50 2024-05-08T20:56:19.569 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.564+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2fdc75a4-710f-4128-88e4-5a342a60985e", "id": 6} v 0) v1 -- 0x7f7a5809d950 con 0x7f7a580d3c50 2024-05-08T20:56:19.577 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a4dffb700 1 -- 172.21.15.195:0/183274903 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fdc75a4-710f-4128-88e4-5a342a60985e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a48021060 con 0x7f7a580d3c50 2024-05-08T20:56:19.577 INFO:teuthology.orchestra.run.smithi195.stdout:6 2024-05-08T20:56:19.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a580d3c50 msgr2=0x7f7a5809dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a580d3c50 0x7f7a5809dca0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c430 tx=0x7f7a4800c740 comp rx=0 tx=0).stop 2024-05-08T20:56:19.578 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 shutdown_connections 2024-05-08T20:56:19.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a58160a30 0x7f7a5809e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a580d3c50 0x7f7a5809dca0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 --2- 172.21.15.195:0/183274903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a580d1e90 0x7f7a58150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 >> 172.21.15.195:0/183274903 conn(0x7f7a5809c500 msgr2=0x7f7a580b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 shutdown_connections 2024-05-08T20:56:19.579 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.572+0000 7f7a5f31e700 1 -- 172.21.15.195:0/183274903 wait complete. 2024-05-08T20:56:19.593 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 5b9f62ec-84d0-4653-b754-f5458cc4abbd 7 2024-05-08T20:56:19.598 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:19.588+0000 7fdeacc562c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:56:19.681 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:19.676+0000 7f90e0fac2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:56:19.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.684+0000 7fb945daf700 1 Processor -- start 2024-05-08T20:56:19.689 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.684+0000 7fb945daf700 1 -- start start 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 0x7fb9400b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb94015def0 0x7fb94006b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb94015a8b0 0x7fb94006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9400b4ce0 con 0x7fb94015def0 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9400b4a00 con 0x7fb94015a8b0 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94015d410 con 0x7fb9400cefe0 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 0x7fb9400b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.693 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 0x7fb9400b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:59884/0 (socket says 172.21.15.195:59884) 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 -- 172.21.15.195:0/1487581791 learned_addr learned my addr 172.21.15.195:0/1487581791 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb9455ae700 1 --2- 172.21.15.195:0/1487581791 >> v2:172.21.15.195:3300/0 conn(0x7fb94015a8b0 0x7fb94006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb93ffff700 1 --2- 172.21.15.195:0/1487581791 >> v2:172.21.15.107:3300/0 conn(0x7fb94015def0 0x7fb94006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 -- 172.21.15.195:0/1487581791 >> v2:172.21.15.195:3300/0 conn(0x7fb94015a8b0 msgr2=0x7fb94006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 --2- 172.21.15.195:0/1487581791 >> v2:172.21.15.195:3300/0 conn(0x7fb94015a8b0 0x7fb94006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 -- 172.21.15.195:0/1487581791 >> v2:172.21.15.107:3300/0 conn(0x7fb94015def0 msgr2=0x7fb94006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 --2- 172.21.15.195:0/1487581791 >> v2:172.21.15.107:3300/0 conn(0x7fb94015def0 0x7fb94006b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 -- 172.21.15.195:0/1487581791 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94015d6f0 con 0x7fb9400cefe0 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb944dad700 1 --2- 172.21.15.195:0/1487581791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 0x7fb9400b4120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9400cbc70 tx=0x7fb934009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad8257d0daa01495 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb93f7fe700 1 -- 172.21.15.195:0/1487581791 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934011830 con 0x7fb9400cefe0 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb93f7fe700 1 -- 172.21.15.195:0/1487581791 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb934011990 con 0x7fb9400cefe0 2024-05-08T20:56:19.694 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb93f7fe700 1 -- 172.21.15.195:0/1487581791 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934011d20 con 0x7fb9400cefe0 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- 172.21.15.195:0/1487581791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 msgr2=0x7fb9400b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- 172.21.15.195:0/1487581791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 0x7fb9400b4120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9400cbc70 tx=0x7fb934009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- 172.21.15.195:0/1487581791 shutdown_connections 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- 172.21.15.195:0/1487581791 >> v2:172.21.15.195:3300/0 conn(0x7fb94015a8b0 0x7fb94006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- 172.21.15.195:0/1487581791 >> v2:172.21.15.107:3300/0 conn(0x7fb94015def0 0x7fb94006b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 --2- 172.21.15.195:0/1487581791 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9400cefe0 0x7fb9400b4120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- 172.21.15.195:0/1487581791 >> 172.21.15.195:0/1487581791 conn(0x7fb940070960 msgr2=0x7fb940070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- 172.21.15.195:0/1487581791 shutdown_connections 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.688+0000 7fb945daf700 1 -- 172.21.15.195:0/1487581791 wait complete. 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 Processor -- start 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 -- start start 2024-05-08T20:56:19.701 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 0x7fb940154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94015a8b0 0x7fb94015c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 0x7fb94014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb940150350 con 0x7fb94015def0 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb940155240 con 0x7fb9400cefe0 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb945daf700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb940155520 con 0x7fb94015a8b0 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 0x7fb940154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb9455ae700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 0x7fb94014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 0x7fb940154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44554/0 (socket says 172.21.15.195:44554) 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb9455ae700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 0x7fb94014fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.195:57644/0 (socket says 172.21.15.195:57644) 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 -- 172.21.15.195:0/4083536951 learned_addr learned my addr 172.21.15.195:0/4083536951 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb93ffff700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94015a8b0 0x7fb94015c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 -- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94015a8b0 msgr2=0x7fb94015c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.702 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94015a8b0 0x7fb94015c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 -- 172.21.15.195:0/4083536951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 msgr2=0x7fb94014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 0x7fb94014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb944dad700 1 -- 172.21.15.195:0/4083536951 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb934009570 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.692+0000 7fb9455ae700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 0x7fb94014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb944dad700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 0x7fb940154bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb94015d550 tx=0x7fb934004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934004240 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93401f070 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb940155800 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934004600 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb940155dc0 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb934021030 con 0x7fb9400cefe0 2024-05-08T20:56:19.703 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fb934024d10 con 0x7fb9400cefe0 2024-05-08T20:56:19.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.696+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9400677c0 con 0x7fb9400cefe0 2024-05-08T20:56:19.704 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.700+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb934043dc0 con 0x7fb9400cefe0 2024-05-08T20:56:19.714 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:19.708+0000 7fdeacc562c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:56:19.779 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.772+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5b9f62ec-84d0-4653-b754-f5458cc4abbd", "id": 7} v 0) v1 -- 0x7fb9400684b0 con 0x7fb9400cefe0 2024-05-08T20:56:19.788 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb93d7fa700 1 -- 172.21.15.195:0/4083536951 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b9f62ec-84d0-4653-b754-f5458cc4abbd", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb934032030 con 0x7fb9400cefe0 2024-05-08T20:56:19.788 INFO:teuthology.orchestra.run.smithi195.stdout:7 2024-05-08T20:56:19.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 msgr2=0x7fb940154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 0x7fb940154bf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb94015d550 tx=0x7fb934004770 comp rx=0 tx=0).stop 2024-05-08T20:56:19.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 shutdown_connections 2024-05-08T20:56:19.790 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb94015def0 0x7fb94014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb94015a8b0 0x7fb94015c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 --2- 172.21.15.195:0/4083536951 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9400cefe0 0x7fb940154bf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 >> 172.21.15.195:0/4083536951 conn(0x7fb940070960 msgr2=0x7fb9400cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 shutdown_connections 2024-05-08T20:56:19.791 INFO:teuthology.orchestra.run.smithi195.stderr:2024-05-08T20:56:19.784+0000 7fb945daf700 1 -- 172.21.15.195:0/4083536951 wait complete. 2024-05-08T20:56:19.803 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T20:56:19.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T20:56:19.803 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:19.800+0000 7f90e0fac2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:56:19.805 INFO:tasks.ceph.osd.0:Started 2024-05-08T20:56:19.805 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T20:56:19.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T20:56:19.807 INFO:tasks.ceph.osd.1:Started 2024-05-08T20:56:19.807 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T20:56:19.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T20:56:19.810 INFO:tasks.ceph.osd.2:Started 2024-05-08T20:56:19.810 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T20:56:19.810 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T20:56:19.812 INFO:tasks.ceph.osd.3:Started 2024-05-08T20:56:19.812 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T20:56:19.813 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T20:56:19.814 INFO:tasks.ceph.osd.4:Started 2024-05-08T20:56:19.814 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T20:56:19.815 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T20:56:19.816 INFO:tasks.ceph.osd.5:Started 2024-05-08T20:56:19.816 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T20:56:19.817 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T20:56:19.818 INFO:tasks.ceph.osd.6:Started 2024-05-08T20:56:19.818 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T20:56:19.819 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T20:56:19.822 INFO:tasks.ceph.osd.7:Started 2024-05-08T20:56:19.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:19.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.928+0000 7fd1f69be700 1 Processor -- start 2024-05-08T20:56:19.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1f69be700 1 -- start start 2024-05-08T20:56:19.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1f69be700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1f006d8e0 0x7fd1f00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1f69be700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1f006dcc0 0x7fd1f0071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1f69be700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f00ad7d0 con 0x7fd1f0072130 2024-05-08T20:56:19.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1f69be700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00ac8e0 con 0x7fd1f006d8e0 2024-05-08T20:56:19.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1f69be700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f00acbc0 con 0x7fd1f006dcc0 2024-05-08T20:56:19.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1f006d8e0 0x7fd1f00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1f006d8e0 0x7fd1f00adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55614/0 (socket says 172.21.15.107:55614) 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 -- 172.21.15.107:0/4216266399 learned_addr learned my addr 172.21.15.107:0/4216266399 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1ef7fe700 1 --2- 172.21.15.107:0/4216266399 >> v2:172.21.15.195:3300/0 conn(0x7fd1f006dcc0 0x7fd1f0071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 -- 172.21.15.107:0/4216266399 >> v2:172.21.15.195:3300/0 conn(0x7fd1f006dcc0 msgr2=0x7fd1f0071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 --2- 172.21.15.107:0/4216266399 >> v2:172.21.15.195:3300/0 conn(0x7fd1f006dcc0 0x7fd1f0071bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1eeffd700 1 -- 172.21.15.107:0/4216266399 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666818382 0 0) 0x7fd1f00ad7d0 con 0x7fd1f0072130 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 -- 172.21.15.107:0/4216266399 >> v1:172.21.15.195:6789/0 conn(0x7fd1f0072130 legacy=0x7fd1f01459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 -- 172.21.15.107:0/4216266399 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00acea0 con 0x7fd1f006d8e0 2024-05-08T20:56:19.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1effff700 1 --2- 172.21.15.107:0/4216266399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f006d8e0 0x7fd1f00adc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd1f006ea80 tx=0x7fd1e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e00cf6c96611cf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1eeffd700 1 -- 172.21.15.107:0/4216266399 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011830 con 0x7fd1f006d8e0 2024-05-08T20:56:19.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1eeffd700 1 -- 172.21.15.107:0/4216266399 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0011990 con 0x7fd1f006d8e0 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.932+0000 7fd1eeffd700 1 -- 172.21.15.107:0/4216266399 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011d20 con 0x7fd1f006d8e0 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 -- 172.21.15.107:0/4216266399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f006d8e0 msgr2=0x7fd1f00adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 --2- 172.21.15.107:0/4216266399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f006d8e0 0x7fd1f00adc60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd1f006ea80 tx=0x7fd1e0009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 -- 172.21.15.107:0/4216266399 shutdown_connections 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 --2- 172.21.15.107:0/4216266399 >> v2:172.21.15.195:3300/0 conn(0x7fd1f006dcc0 0x7fd1f0071bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 --2- 172.21.15.107:0/4216266399 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f006d8e0 0x7fd1f00adc60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 -- 172.21.15.107:0/4216266399 >> 172.21.15.107:0/4216266399 conn(0x7fd1f00b0cd0 msgr2=0x7fd1f00b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 -- 172.21.15.107:0/4216266399 shutdown_connections 2024-05-08T20:56:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 -- 172.21.15.107:0/4216266399 wait complete. 2024-05-08T20:56:19.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 Processor -- start 2024-05-08T20:56:19.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.936+0000 7fd1f69be700 1 -- start start 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1f006d8e0 0x7fd1f015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1f006dcc0 0x7fd1f0141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 0x7fd1f01442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f01434e0 con 0x7fd1f0072130 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f015d510 con 0x7fd1f006dcc0 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f0142860 con 0x7fd1f006d8e0 2024-05-08T20:56:19.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 0x7fd1f01442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 0x7fd1f01442d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55626/0 (socket says 172.21.15.107:55626) 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 -- 172.21.15.107:0/2849382026 learned_addr learned my addr 172.21.15.107:0/2849382026 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1ef7fe700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1f006dcc0 0x7fd1f0141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1effff700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1f006d8e0 0x7fd1f015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 -- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1f006d8e0 msgr2=0x7fd1f015cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1f006d8e0 0x7fd1f015cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 -- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1f006dcc0 msgr2=0x7fd1f0141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1f006dcc0 0x7fd1f0141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 -- 172.21.15.107:0/2849382026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0009570 con 0x7fd1f0072130 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f4f5b700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 0x7fd1f01442d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800cc10 tx=0x7fd1e800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8003e50 con 0x7fd1f0072130 2024-05-08T20:56:19.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e800a650 con 0x7fd1f0072130 2024-05-08T20:56:19.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800aa00 con 0x7fd1f0072130 2024-05-08T20:56:19.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f00ae320 con 0x7fd1f0072130 2024-05-08T20:56:19.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f0142e20 con 0x7fd1f0072130 2024-05-08T20:56:19.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd1e8005070 con 0x7fd1f0072130 2024-05-08T20:56:19.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.940+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd1e8012400 con 0x7fd1f0072130 2024-05-08T20:56:19.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.948+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f0143620 con 0x7fd1f0072130 2024-05-08T20:56:19.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:19.952+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fd1f0143620 con 0x7fd1f0072130 2024-05-08T20:56:20.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.020+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f00adc40 con 0x7fd1f0072130 2024-05-08T20:56:20.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1ecff9700 1 -- 172.21.15.107:0/2849382026 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd1e8017070 con 0x7fd1f0072130 2024-05-08T20:56:20.030 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:20.030 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:19.778082+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 msgr2=0x7fd1f01442d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 0x7fd1f01442d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800cc10 tx=0x7fd1e800cf20 comp rx=0 tx=0).stop 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 shutdown_connections 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1f0072130 0x7fd1f01442d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1f006dcc0 0x7fd1f0141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 --2- 172.21.15.107:0/2849382026 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1f006d8e0 0x7fd1f015cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 >> 172.21.15.107:0/2849382026 conn(0x7fd1f00b0cd0 msgr2=0x7fd1f00b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 shutdown_connections 2024-05-08T20:56:20.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:20.024+0000 7fd1f69be700 1 -- 172.21.15.107:0/2849382026 wait complete. 2024-05-08T20:56:20.042 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T20:56:20.042 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T20:56:20.079 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:20.072+0000 7fdeacc562c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:56:20.157 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:20.152+0000 7f90e0fac2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:56:20.187 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-05-08T20:56:20.180+0000 7fc782ec5880 -1 Falling back to public interface 2024-05-08T20:56:20.188 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-05-08T20:56:20.180+0000 7f908853a880 -1 Falling back to public interface 2024-05-08T20:56:20.189 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-05-08T20:56:20.184+0000 7f2fc6e56880 -1 Falling back to public interface 2024-05-08T20:56:20.193 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-05-08T20:56:20.188+0000 7fbd04b53880 -1 Falling back to public interface 2024-05-08T20:56:20.207 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-05-08T20:56:20.200+0000 7fafb3beb880 -1 Falling back to public interface 2024-05-08T20:56:20.265 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:20.256+0000 7fdeacc562c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:56:20.333 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:20.324+0000 7fdeacc562c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:56:20.347 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:20.340+0000 7f90e0fac2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:56:20.414 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:20.408+0000 7f90e0fac2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:56:20.429 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-05-08T20:56:20.424+0000 7fb583dd4880 -1 Falling back to public interface 2024-05-08T20:56:20.441 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-05-08T20:56:20.436+0000 7f1dcdce9880 -1 Falling back to public interface 2024-05-08T20:56:20.444 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-05-08T20:56:20.436+0000 7f3456756880 -1 Falling back to public interface 2024-05-08T20:56:20.492 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:20.484+0000 7fdeacc562c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:56:20.578 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:20.572+0000 7f90e0fac2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:56:20.848 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:20.951 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 Processor -- start 2024-05-08T20:56:20.951 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 -- start start 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f881c159e70 0x7f881c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f881c161030 0x7f881c163420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c06bd10 con 0x7f881c159a90 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c0b40e0 con 0x7f881c159e70 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881b59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c06d440 con 0x7f881c161030 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881a59c700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f881c159a90 0x7f881c0b2fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36132/0 (socket says 172.21.15.107:36132) 2024-05-08T20:56:20.954 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881a59c700 1 -- 172.21.15.107:0/932251192 learned_addr learned my addr 172.21.15.107:0/932251192 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f8819d9b700 1 --2- 172.21.15.107:0/932251192 >> v2:172.21.15.107:3300/0 conn(0x7f881c159e70 0x7f881c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881ad9d700 1 --2- 172.21.15.107:0/932251192 >> v2:172.21.15.195:3300/0 conn(0x7f881c161030 0x7f881c163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881959a700 1 -- 172.21.15.107:0/932251192 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721566083 0 0) 0x7f881c06bd10 con 0x7f881c159a90 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881959a700 1 -- 172.21.15.107:0/932251192 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88040046e0 con 0x7f881c159a90 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f8819d9b700 1 -- 172.21.15.107:0/932251192 >> v2:172.21.15.195:3300/0 conn(0x7f881c161030 msgr2=0x7f881c163420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f8819d9b700 1 --2- 172.21.15.107:0/932251192 >> v2:172.21.15.195:3300/0 conn(0x7f881c161030 0x7f881c163420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f8819d9b700 1 -- 172.21.15.107:0/932251192 >> v1:172.21.15.107:6789/0 conn(0x7f881c159a90 legacy=0x7f881c0b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f8819d9b700 1 -- 172.21.15.107:0/932251192 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c0b3b20 con 0x7f881c159e70 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881ad9d700 1 --2- 172.21.15.107:0/932251192 >> v2:172.21.15.195:3300/0 conn(0x7f881c161030 0x7f881c163420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f8819d9b700 1 --2- 172.21.15.107:0/932251192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c159e70 0x7f881c15a300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f881c0b4b00 tx=0x7f8810009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394f17eb8a1b2aa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.944+0000 7f881959a700 1 -- 172.21.15.107:0/932251192 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810011830 con 0x7f881c159e70 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881959a700 1 -- 172.21.15.107:0/932251192 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8810011990 con 0x7f881c159e70 2024-05-08T20:56:20.955 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881959a700 1 -- 172.21.15.107:0/932251192 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810011d20 con 0x7f881c159e70 2024-05-08T20:56:20.956 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 -- 172.21.15.107:0/932251192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c159e70 msgr2=0x7f881c15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:20.956 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 --2- 172.21.15.107:0/932251192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c159e70 0x7f881c15a300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f881c0b4b00 tx=0x7f8810009b30 comp rx=0 tx=0).stop 2024-05-08T20:56:20.956 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 -- 172.21.15.107:0/932251192 shutdown_connections 2024-05-08T20:56:20.956 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 --2- 172.21.15.107:0/932251192 >> v2:172.21.15.195:3300/0 conn(0x7f881c161030 0x7f881c163420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.957 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 --2- 172.21.15.107:0/932251192 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c159e70 0x7f881c15a300 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.957 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 -- 172.21.15.107:0/932251192 >> 172.21.15.107:0/932251192 conn(0x7f881c0b1da0 msgr2=0x7f881c0cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:20.957 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 -- 172.21.15.107:0/932251192 shutdown_connections 2024-05-08T20:56:20.957 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 -- 172.21.15.107:0/932251192 wait complete. 2024-05-08T20:56:20.958 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 Processor -- start 2024-05-08T20:56:20.958 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.948+0000 7f881b59e700 1 -- start start 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c159a90 0x7f881c13c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c159e70 0x7f881c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 0x7f881c0ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c13dd30 con 0x7f881c161030 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c13bbf0 con 0x7f881c159a90 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c13d1b0 con 0x7f881c159e70 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 0x7f881c0ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:20.960 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 0x7f881c0ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55650/0 (socket says 172.21.15.107:55650) 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 -- 172.21.15.107:0/1020043124 learned_addr learned my addr 172.21.15.107:0/1020043124 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881a59c700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c159a90 0x7f881c13c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f8819d9b700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c159e70 0x7f881c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 -- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c159e70 msgr2=0x7f881c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c159e70 0x7f881c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 -- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c159a90 msgr2=0x7f881c13c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c159a90 0x7f881c13c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 -- 172.21.15.107:0/1020043124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100094b0 con 0x7f881c161030 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881ad9d700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 0x7f881c0ad930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8814007e70 tx=0x7f881400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881400dd20 con 0x7f881c161030 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881400f040 con 0x7f881c161030 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881400dea0 con 0x7f881c161030 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c13d490 con 0x7f881c161030 2024-05-08T20:56:20.961 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c13da50 con 0x7f881c161030 2024-05-08T20:56:20.962 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8814004030 con 0x7f881c161030 2024-05-08T20:56:20.962 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8814015b10 con 0x7f881c161030 2024-05-08T20:56:20.962 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.952+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c0af750 con 0x7f881c161030 2024-05-08T20:56:20.964 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:20.956+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f881401a070 con 0x7f881c161030 2024-05-08T20:56:21.028 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f881c06e680 con 0x7f881c161030 2024-05-08T20:56:21.029 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f880affd700 1 -- 172.21.15.107:0/1020043124 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8814004510 con 0x7f881c161030 2024-05-08T20:56:21.029 INFO:teuthology.misc.health.smithi107.stdout: 2024-05-08T20:56:21.029 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":10,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:19.778082+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:21.030 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 msgr2=0x7f881c0ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:21.030 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 0x7f881c0ad930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8814007e70 tx=0x7f881400d3b0 comp rx=0 tx=0).stop 2024-05-08T20:56:21.030 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 shutdown_connections 2024-05-08T20:56:21.031 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f881c161030 0x7f881c0ad930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:21.031 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f881c159e70 0x7f881c151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:21.031 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 --2- 172.21.15.107:0/1020043124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f881c159a90 0x7f881c13c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:21.031 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.020+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 >> 172.21.15.107:0/1020043124 conn(0x7f881c0b1da0 msgr2=0x7f881c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:21.031 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.024+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 shutdown_connections 2024-05-08T20:56:21.031 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:21.024+0000 7f881b59e700 1 -- 172.21.15.107:0/1020043124 wait complete. 2024-05-08T20:56:21.041 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T20:56:21.199 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.192+0000 7fdeacc562c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:56:21.236 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:21.232+0000 7f90e0fac2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:56:21.270 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.260+0000 7fdeacc562c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:56:21.303 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:21.296+0000 7f90e0fac2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:56:21.435 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.428+0000 7fdeacc562c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:56:21.465 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:21.460+0000 7f90e0fac2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:56:21.502 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.492+0000 7fdeacc562c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:56:21.531 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:21.528+0000 7f90e0fac2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:56:21.576 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.568+0000 7fdeacc562c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:56:21.606 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:21.600+0000 7f90e0fac2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:56:21.900 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.892+0000 7fdeacc562c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:56:21.934 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:21.928+0000 7f90e0fac2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:56:21.976 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:21.968+0000 7fdeacc562c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:56:22.009 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:22.004+0000 7f90e0fac2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:56:22.663 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:22.656+0000 7fdeacc562c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:56:22.708 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-05-08T20:56:22.704+0000 7f90e0fac2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:56:23.708 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:23.700+0000 7fde937cf700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T20:56:23.709 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-05-08T20:56:23.700+0000 7fde937cf700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T20:56:23.845 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-05-08T20:56:23.836+0000 7f908853a880 -1 osd.3 0 log_to_monitors true 2024-05-08T20:56:23.865 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-05-08T20:56:23.856+0000 7fc782ec5880 -1 osd.1 0 log_to_monitors true 2024-05-08T20:56:24.076 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-05-08T20:56:24.072+0000 7fbd04b53880 -1 osd.4 0 log_to_monitors true 2024-05-08T20:56:24.090 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-05-08T20:56:24.080+0000 7fafb3beb880 -1 osd.2 0 log_to_monitors true 2024-05-08T20:56:24.101 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-05-08T20:56:24.096+0000 7f2fc6e56880 -1 osd.5 0 log_to_monitors true 2024-05-08T20:56:24.237 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-05-08T20:56:24.232+0000 7fb583dd4880 -1 osd.6 0 log_to_monitors true 2024-05-08T20:56:24.281 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-05-08T20:56:24.272+0000 7f3456756880 -1 osd.0 0 log_to_monitors true 2024-05-08T20:56:24.328 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-05-08T20:56:24.324+0000 7f1dcdce9880 -1 osd.7 0 log_to_monitors true 2024-05-08T20:56:27.239 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-05-08T20:56:27.231+0000 7fbd01b1a700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T20:56:27.243 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-05-08T20:56:27.239+0000 7fbcf8444700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.277 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-05-08T20:56:27.271+0000 7f2fc3e1d700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T20:56:27.281 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-05-08T20:56:27.275+0000 7f2fba747700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.290 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-05-08T20:56:27.283+0000 7fb580d9b700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T20:56:27.293 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-05-08T20:56:27.287+0000 7fb5776c5700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.319 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-05-08T20:56:27.311+0000 7f1dcacb0700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T20:56:27.323 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-05-08T20:56:27.315+0000 7f1dc15da700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.835 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-05-08T20:56:27.828+0000 7fc77fe8c700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T20:56:27.842 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-05-08T20:56:27.836+0000 7fc7767b6700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.847 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:27.904 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-05-08T20:56:27.896+0000 7f3451d72700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T20:56:27.908 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-05-08T20:56:27.900+0000 7f344a047700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.946 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-05-08T20:56:27.940+0000 7fafaf207700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T20:56:27.954 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-05-08T20:56:27.948+0000 7fafa74dc700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.961 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-05-08T20:56:27.952+0000 7f9085501700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T20:56:27.966 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.956+0000 7f285b11b700 1 Processor -- start 2024-05-08T20:56:27.966 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.956+0000 7f285b11b700 1 -- start start 2024-05-08T20:56:27.966 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f907be2b700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:56:27.969 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f285415d340 0x7f2854071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28540b2f80 0x7f285406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285406ad00 con 0x7f285406a360 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285406d090 con 0x7f28540b2f80 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2854072310 con 0x7f285415d340 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28540b2f80 0x7f285406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f28540b2f80 0x7f285406a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38076/0 (socket says 172.21.15.107:38076) 2024-05-08T20:56:27.970 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 -- 172.21.15.107:0/2999267795 learned_addr learned my addr 172.21.15.107:0/2999267795 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a119700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f285415d340 0x7f2854071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 -- 172.21.15.107:0/2999267795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f285415d340 msgr2=0x7f2854071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f285415d340 0x7f2854071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 -- 172.21.15.107:0/2999267795 >> v1:172.21.15.195:6789/0 conn(0x7f285406a360 legacy=0x7f2854160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 -- 172.21.15.107:0/2999267795 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285406c480 con 0x7f28540b2f80 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a119700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f285415d340 0x7f2854071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285a91a700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28540b2f80 0x7f285406a7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f284c009e50 tx=0x7f284c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d669f0e830fcc18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f2859117700 1 -- 172.21.15.107:0/2999267795 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00e070 con 0x7f28540b2f80 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f2859117700 1 -- 172.21.15.107:0/2999267795 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c00b9c0 con 0x7f28540b2f80 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f2859117700 1 -- 172.21.15.107:0/2999267795 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00bd70 con 0x7f28540b2f80 2024-05-08T20:56:27.971 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- 172.21.15.107:0/2999267795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28540b2f80 msgr2=0x7f285406a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28540b2f80 0x7f285406a7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f284c009e50 tx=0x7f284c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- 172.21.15.107:0/2999267795 shutdown_connections 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f28540b2f80 0x7f285406a7c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 --2- 172.21.15.107:0/2999267795 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f285415d340 0x7f2854071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- 172.21.15.107:0/2999267795 >> 172.21.15.107:0/2999267795 conn(0x7f28540cee60 msgr2=0x7f28540cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- 172.21.15.107:0/2999267795 shutdown_connections 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- 172.21.15.107:0/2999267795 wait complete. 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 Processor -- start 2024-05-08T20:56:27.972 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.960+0000 7f285b11b700 1 -- start start 2024-05-08T20:56:27.975 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285406a360 0x7f2854147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.975 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28540b2f80 0x7f285409a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.975 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 0x7f2854149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285414d9d0 con 0x7f285415d340 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28541477d0 con 0x7f285406a360 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285409b420 con 0x7f28540b2f80 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 0x7f2854149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 0x7f2854149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38080/0 (socket says 172.21.15.107:38080) 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 -- 172.21.15.107:0/2305894743 learned_addr learned my addr 172.21.15.107:0/2305894743 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a119700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285406a360 0x7f2854147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f2859918700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28540b2f80 0x7f285409a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.976 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 -- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28540b2f80 msgr2=0x7f285409a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28540b2f80 0x7f285409a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 -- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285406a360 msgr2=0x7f2854147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285406a360 0x7f2854147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 -- 172.21.15.107:0/2305894743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c009b30 con 0x7f285415d340 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285a91a700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 0x7f2854149b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f285406ae90 tx=0x7f284c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0048b0 con 0x7f285415d340 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c0092e0 con 0x7f285415d340 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2854147be0 con 0x7f285415d340 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c01c660 con 0x7f285415d340 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285409b140 con 0x7f285415d340 2024-05-08T20:56:27.977 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285406c020 con 0x7f285415d340 2024-05-08T20:56:27.978 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f284c01c7c0 con 0x7f285415d340 2024-05-08T20:56:27.978 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.964+0000 7f284affd700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f28380666a0 0x7f2838068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:27.978 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.968+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f284c084e50 con 0x7f285415d340 2024-05-08T20:56:27.978 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.968+0000 7f285a119700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f28380666a0 0x7f2838068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:27.978 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.968+0000 7f285a119700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f28380666a0 0x7f2838068b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f28500044b0 tx=0x7f2850008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:27.979 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:27.972+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f284c0530c0 con 0x7f285415d340 2024-05-08T20:56:28.136 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.128+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28540731d0 con 0x7f285415d340 2024-05-08T20:56:28.137 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.128+0000 7f284affd700 1 -- 172.21.15.107:0/2305894743 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f284c0566e0 con 0x7f285415d340 2024-05-08T20:56:28.137 INFO:teuthology.misc.health.smithi107.stdout: 2024-05-08T20:56:28.138 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":12,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:25.695559+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f28380666a0 msgr2=0x7f2838068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f28380666a0 0x7f2838068b60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f28500044b0 tx=0x7f2850008040 comp rx=0 tx=0).stop 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 msgr2=0x7f2854149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 0x7f2854149b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f285406ae90 tx=0x7f284c004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 shutdown_connections 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f285415d340 0x7f2854149b40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f28380666a0 0x7f2838068b60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f28540b2f80 0x7f285409a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 --2- 172.21.15.107:0/2305894743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285406a360 0x7f2854147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:28.140 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 >> 172.21.15.107:0/2305894743 conn(0x7f28540cee60 msgr2=0x7f28540ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:28.141 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 shutdown_connections 2024-05-08T20:56:28.141 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:28.132+0000 7f285b11b700 1 -- 172.21.15.107:0/2305894743 wait complete. 2024-05-08T20:56:28.150 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T20:56:34.957 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:35.067 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 Processor -- start 2024-05-08T20:56:35.067 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 -- start start 2024-05-08T20:56:35.068 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe9440cd7b0 0x7fe94415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.068 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe94406aa70 0x7fe94415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440cdb90 con 0x7fe944071b80 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440adb70 con 0x7fe94406aa70 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94b08c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9440ade50 con 0x7fe9440cd7b0 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe94406aa70 0x7fe94415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe94406aa70 0x7fe94415b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38114/0 (socket says 172.21.15.107:38114) 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 -- 172.21.15.107:0/1678856832 learned_addr learned my addr 172.21.15.107:0/1678856832 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:35.069 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a08a700 1 --2- 172.21.15.107:0/1678856832 >> v2:172.21.15.195:3300/0 conn(0x7fe9440cd7b0 0x7fe94415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.070 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 -- 172.21.15.107:0/1678856832 >> v2:172.21.15.195:3300/0 conn(0x7fe9440cd7b0 msgr2=0x7fe94415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:35.070 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 --2- 172.21.15.107:0/1678856832 >> v2:172.21.15.195:3300/0 conn(0x7fe9440cd7b0 0x7fe94415eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.070 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 -- 172.21.15.107:0/1678856832 >> v1:172.21.15.195:6789/0 conn(0x7fe944071b80 legacy=0x7fe94406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 -- 172.21.15.107:0/1678856832 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440ac0f0 con 0x7fe94406aa70 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a08a700 1 --2- 172.21.15.107:0/1678856832 >> v2:172.21.15.195:3300/0 conn(0x7fe9440cd7b0 0x7fe94415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe94a88b700 1 --2- 172.21.15.107:0/1678856832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe94406aa70 0x7fe94415b800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe94406e240 tx=0x7fe93c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c12961ea05d7a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe949088700 1 -- 172.21.15.107:0/1678856832 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00e070 con 0x7fe94406aa70 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe949088700 1 -- 172.21.15.107:0/1678856832 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00b9c0 con 0x7fe94406aa70 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.060+0000 7fe949088700 1 -- 172.21.15.107:0/1678856832 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c00bd70 con 0x7fe94406aa70 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- 172.21.15.107:0/1678856832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe94406aa70 msgr2=0x7fe94415b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1678856832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe94406aa70 0x7fe94415b800 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe94406e240 tx=0x7fe93c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- 172.21.15.107:0/1678856832 shutdown_connections 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1678856832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe94406aa70 0x7fe94415b800 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1678856832 >> v2:172.21.15.195:3300/0 conn(0x7fe9440cd7b0 0x7fe94415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- 172.21.15.107:0/1678856832 >> 172.21.15.107:0/1678856832 conn(0x7fe9440cee60 msgr2=0x7fe9440cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.071 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- 172.21.15.107:0/1678856832 shutdown_connections 2024-05-08T20:56:35.072 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- 172.21.15.107:0/1678856832 wait complete. 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 Processor -- start 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- start start 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe94406aa70 0x7fe9440b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 0x7fe94415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9440cd7b0 0x7fe944152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9441f2df0 con 0x7fe944071b80 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9441f30b0 con 0x7fe9440cd7b0 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94b08c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9441f3390 con 0x7fe94406aa70 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 0x7fe94415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.074 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 0x7fe94415b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38118/0 (socket says 172.21.15.107:38118) 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 -- 172.21.15.107:0/1148359765 learned_addr learned my addr 172.21.15.107:0/1148359765 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94a88b700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9440cd7b0 0x7fe944152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94a08a700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe94406aa70 0x7fe9440b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 -- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe94406aa70 msgr2=0x7fe9440b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe94406aa70 0x7fe9440b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 -- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9440cd7b0 msgr2=0x7fe944152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9440cd7b0 0x7fe944152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 -- 172.21.15.107:0/1148359765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c009b30 con 0x7fe944071b80 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe94a08a700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe94406aa70 0x7fe9440b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe949889700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 0x7fe94415b860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c500 tx=0x7fe93400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340052d0 con 0x7fe944071b80 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.064+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934005430 con 0x7fe944071b80 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340055a0 con 0x7fe944071b80 2024-05-08T20:56:35.075 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9441f3670 con 0x7fe944071b80 2024-05-08T20:56:35.076 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe944153220 con 0x7fe944071b80 2024-05-08T20:56:35.077 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9441f3b90 con 0x7fe944071b80 2024-05-08T20:56:35.077 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9340038e0 con 0x7fe944071b80 2024-05-08T20:56:35.078 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe942ffd700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe930066730 0x7fe930068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.078 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe94a08a700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe930066730 0x7fe930068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.078 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe934083300 con 0x7fe944071b80 2024-05-08T20:56:35.078 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.068+0000 7fe94a08a700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe930066730 0x7fe930068bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9440ac550 tx=0x7fe938008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.086 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.076+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe9441f3b90 con 0x7fe944071b80 2024-05-08T20:56:35.256 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.248+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9441f3b90 con 0x7fe944071b80 2024-05-08T20:56:35.258 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe942ffd700 1 -- 172.21.15.107:0/1148359765 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fe9441f3b90 con 0x7fe944071b80 2024-05-08T20:56:35.259 INFO:teuthology.misc.health.smithi107.stdout: 2024-05-08T20:56:35.259 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":16,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:31.258613+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:35.261 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe930066730 msgr2=0x7fe930068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.261 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe930066730 0x7fe930068bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9440ac550 tx=0x7fe938008040 comp rx=0 tx=0).stop 2024-05-08T20:56:35.261 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 msgr2=0x7fe94415b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.261 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 0x7fe94415b860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c500 tx=0x7fe93400c810 comp rx=0 tx=0).stop 2024-05-08T20:56:35.261 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 shutdown_connections 2024-05-08T20:56:35.261 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9440cd7b0 0x7fe944152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.262 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe944071b80 0x7fe94415b860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.262 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe930066730 0x7fe930068bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.262 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 --2- 172.21.15.107:0/1148359765 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe94406aa70 0x7fe9440b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.262 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 >> 172.21.15.107:0/1148359765 conn(0x7fe9440cee60 msgr2=0x7fe9440b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.262 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 shutdown_connections 2024-05-08T20:56:35.262 INFO:teuthology.misc.health.smithi107.stderr:2024-05-08T20:56:35.252+0000 7fe94b08c700 1 -- 172.21.15.107:0/1148359765 wait complete. 2024-05-08T20:56:35.272 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T20:56:35.272 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T20:56:35.273 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-08T20:56:35.273 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-08T20:56:35.276 INFO:tasks.ceph.mds.a:Started 2024-05-08T20:56:35.276 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-08T20:56:35.276 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-08T20:56:35.278 INFO:tasks.ceph.mds.c:Started 2024-05-08T20:56:35.278 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-08T20:56:35.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-08T20:56:35.280 INFO:tasks.ceph.mds.b:Started 2024-05-08T20:56:35.281 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-08T20:56:35.281 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-08T20:56:35.283 INFO:tasks.ceph.mds.d:Started 2024-05-08T20:56:35.283 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-08T20:56:35.284 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:35.344 INFO:tasks.ceph.mds.c.smithi107.stdout:starting mds.c at 2024-05-08T20:56:35.349 INFO:tasks.ceph.mds.a.smithi107.stdout:starting mds.a at 2024-05-08T20:56:35.361 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-05-08T20:56:35.362 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-05-08T20:56:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.380+0000 7f3d1ffff700 1 Processor -- start 2024-05-08T20:56:35.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.380+0000 7f3d1ffff700 1 -- start start 2024-05-08T20:56:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3d2013ffc0 0x7f3d2015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2006f3f0 con 0x7f3d201403a0 2024-05-08T20:56:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2015db00 con 0x7f3d2006ba80 2024-05-08T20:56:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2015b3a0 con 0x7f3d2013ffc0 2024-05-08T20:56:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1e7fc700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3d201403a0 0x7f3d2006b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57306/0 (socket says 172.21.15.107:57306) 2024-05-08T20:56:35.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1e7fc700 1 -- 172.21.15.107:0/1179338107 learned_addr learned my addr 172.21.15.107:0/1179338107 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:35.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1effd700 1 --2- 172.21.15.107:0/1179338107 >> v2:172.21.15.195:3300/0 conn(0x7f3d2013ffc0 0x7f3d2015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1dffb700 1 -- 172.21.15.107:0/1179338107 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718957222 0 0) 0x7f3d2006f3f0 con 0x7f3d201403a0 2024-05-08T20:56:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1dffb700 1 -- 172.21.15.107:0/1179338107 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d080035d0 con 0x7f3d201403a0 2024-05-08T20:56:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1dffb700 1 -- 172.21.15.107:0/1179338107 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557832116 0 0) 0x7f3d2015db00 con 0x7f3d2006ba80 2024-05-08T20:56:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1effd700 1 -- 172.21.15.107:0/1179338107 >> v1:172.21.15.195:6789/0 conn(0x7f3d2006ba80 legacy=0x7f3d200cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1effd700 1 -- 172.21.15.107:0/1179338107 >> v1:172.21.15.107:6789/0 conn(0x7f3d201403a0 legacy=0x7f3d2006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1effd700 1 -- 172.21.15.107:0/1179338107 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200cc4e0 con 0x7f3d2013ffc0 2024-05-08T20:56:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1effd700 1 --2- 172.21.15.107:0/1179338107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2013ffc0 0x7f3d2015ae60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009880 tx=0x7f3d10009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=582bea32f58b2cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1dffb700 1 -- 172.21.15.107:0/1179338107 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10011830 con 0x7f3d2013ffc0 2024-05-08T20:56:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1dffb700 1 -- 172.21.15.107:0/1179338107 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10011990 con 0x7f3d2013ffc0 2024-05-08T20:56:35.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1dffb700 1 -- 172.21.15.107:0/1179338107 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d10011d20 con 0x7f3d2013ffc0 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- 172.21.15.107:0/1179338107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2013ffc0 msgr2=0x7f3d2015ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/1179338107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2013ffc0 0x7f3d2015ae60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009880 tx=0x7f3d10009b90 comp rx=0 tx=0).stop 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- 172.21.15.107:0/1179338107 shutdown_connections 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/1179338107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2013ffc0 0x7f3d2015ae60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- 172.21.15.107:0/1179338107 >> 172.21.15.107:0/1179338107 conn(0x7f3d200709c0 msgr2=0x7f3d20070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- 172.21.15.107:0/1179338107 shutdown_connections 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.384+0000 7f3d1ffff700 1 -- 172.21.15.107:0/1179338107 wait complete. 2024-05-08T20:56:35.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 Processor -- start 2024-05-08T20:56:35.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 -- start start 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2006ba80 0x7f3d201397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d2013ffc0 0x7f3d2013afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 0x7f3d2013c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20139cf0 con 0x7f3d201403a0 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2013ab10 con 0x7f3d2006ba80 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1ffff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20139f00 con 0x7f3d2013ffc0 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 0x7f3d2013c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 0x7f3d2013c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38172/0 (socket says 172.21.15.107:38172) 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 -- 172.21.15.107:0/3207795944 learned_addr learned my addr 172.21.15.107:0/3207795944 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1effd700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2006ba80 0x7f3d201397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1e7fc700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d2013ffc0 0x7f3d2013afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 -- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d2013ffc0 msgr2=0x7f3d2013afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d2013ffc0 0x7f3d2013afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 -- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2006ba80 msgr2=0x7f3d201397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2006ba80 0x7f3d201397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.388+0000 7f3d1f7fe700 1 -- 172.21.15.107:0/3207795944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100094b0 con 0x7f3d201403a0 2024-05-08T20:56:35.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d1f7fe700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 0x7f3d2013c410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800cc70 tx=0x7f3d1800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18003e50 con 0x7f3d201403a0 2024-05-08T20:56:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1800a6f0 con 0x7f3d201403a0 2024-05-08T20:56:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800aaa0 con 0x7f3d201403a0 2024-05-08T20:56:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2013a1e0 con 0x7f3d201403a0 2024-05-08T20:56:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2013a7a0 con 0x7f3d201403a0 2024-05-08T20:56:35.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d1800ac00 con 0x7f3d201403a0 2024-05-08T20:56:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2013acc0 con 0x7f3d201403a0 2024-05-08T20:56:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d077fe700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d0c066730 0x7f3d0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d18083870 con 0x7f3d201403a0 2024-05-08T20:56:35.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.392+0000 7f3d1effd700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d0c066730 0x7f3d0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.396+0000 7f3d1effd700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d0c066730 0x7f3d0c068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3d100090b0 tx=0x7f3d10008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.404+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3d2013acc0 con 0x7f3d201403a0 2024-05-08T20:56:35.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.576+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d200cc7c0 con 0x7f3d201403a0 2024-05-08T20:56:35.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.576+0000 7f3d077fe700 1 -- 172.21.15.107:0/3207795944 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f3d18017020 con 0x7f3d201403a0 2024-05-08T20:56:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:35.585 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:31.258613+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:35.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d0c066730 msgr2=0x7f3d0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d0c066730 0x7f3d0c068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3d100090b0 tx=0x7f3d10008030 comp rx=0 tx=0).stop 2024-05-08T20:56:35.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 msgr2=0x7f3d2013c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 0x7f3d2013c410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800cc70 tx=0x7f3d1800cf80 comp rx=0 tx=0).stop 2024-05-08T20:56:35.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 shutdown_connections 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d201403a0 0x7f3d2013c410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d0c066730 0x7f3d0c068bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d2013ffc0 0x7f3d2013afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 --2- 172.21.15.107:0/3207795944 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d2006ba80 0x7f3d201397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 >> 172.21.15.107:0/3207795944 conn(0x7f3d200709c0 msgr2=0x7f3d2006b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 shutdown_connections 2024-05-08T20:56:35.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.580+0000 7f3d1ffff700 1 -- 172.21.15.107:0/3207795944 wait complete. 2024-05-08T20:56:35.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:56:35.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:56:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 Processor -- start 2024-05-08T20:56:35.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 -- start start 2024-05-08T20:56:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f49401544a0 0x7f49400711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f494015aa40 0x7f49400716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49400aee50 con 0x7f494015e530 2024-05-08T20:56:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494015b260 con 0x7f49401544a0 2024-05-08T20:56:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.716+0000 7f4946881700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400ae2f0 con 0x7f494015aa40 2024-05-08T20:56:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494587f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f49401544a0 0x7f49400711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494507e700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f494015e530 0x7f494015a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57316/0 (socket says 172.21.15.107:57316) 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494507e700 1 -- 172.21.15.107:0/573662846 learned_addr learned my addr 172.21.15.107:0/573662846 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946080700 1 --2- 172.21.15.107:0/573662846 >> v2:172.21.15.195:3300/0 conn(0x7f494015aa40 0x7f49400716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494587f700 1 -- 172.21.15.107:0/573662846 >> v2:172.21.15.195:3300/0 conn(0x7f494015aa40 msgr2=0x7f49400716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494587f700 1 --2- 172.21.15.107:0/573662846 >> v2:172.21.15.195:3300/0 conn(0x7f494015aa40 0x7f49400716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494587f700 1 -- 172.21.15.107:0/573662846 >> v1:172.21.15.107:6789/0 conn(0x7f494015e530 legacy=0x7f494015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494587f700 1 -- 172.21.15.107:0/573662846 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494015af80 con 0x7f49401544a0 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494587f700 1 --2- 172.21.15.107:0/573662846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49401544a0 0x7f49400711a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f494006d400 tx=0x7f493000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426de3146ef82a84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494487d700 1 -- 172.21.15.107:0/573662846 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000bd20 con 0x7f49401544a0 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494487d700 1 -- 172.21.15.107:0/573662846 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000be80 con 0x7f49401544a0 2024-05-08T20:56:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f494487d700 1 -- 172.21.15.107:0/573662846 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300116a0 con 0x7f49401544a0 2024-05-08T20:56:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 -- 172.21.15.107:0/573662846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49401544a0 msgr2=0x7f49400711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 --2- 172.21.15.107:0/573662846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49401544a0 0x7f49400711a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f494006d400 tx=0x7f493000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 -- 172.21.15.107:0/573662846 shutdown_connections 2024-05-08T20:56:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 --2- 172.21.15.107:0/573662846 >> v2:172.21.15.195:3300/0 conn(0x7f494015aa40 0x7f49400716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 --2- 172.21.15.107:0/573662846 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f49401544a0 0x7f49400711a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 -- 172.21.15.107:0/573662846 >> 172.21.15.107:0/573662846 conn(0x7f49400b1a60 msgr2=0x7f49400b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 -- 172.21.15.107:0/573662846 shutdown_connections 2024-05-08T20:56:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.720+0000 7f4946881700 1 -- 172.21.15.107:0/573662846 wait complete. 2024-05-08T20:56:35.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 Processor -- start 2024-05-08T20:56:35.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 -- start start 2024-05-08T20:56:35.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49401544a0 0x7f49400b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 0x7f494014ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f494015e530 0x7f494014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494014f150 con 0x7f494015aa40 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494014f3f0 con 0x7f494015e530 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49400b2990 con 0x7f49401544a0 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 0x7f494014ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 0x7f494014ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38196/0 (socket says 172.21.15.107:38196) 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 -- 172.21.15.107:0/106338656 learned_addr learned my addr 172.21.15.107:0/106338656 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946080700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f494015e530 0x7f494014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494587f700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49401544a0 0x7f49400b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 -- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49401544a0 msgr2=0x7f49400b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49401544a0 0x7f49400b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 -- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f494015e530 msgr2=0x7f494014ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f494015e530 0x7f494014ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 -- 172.21.15.107:0/106338656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930009a70 con 0x7f494015aa40 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494587f700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49401544a0 0x7f49400b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f494507e700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 0x7f494014ca30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4934001eb0 tx=0x7f493400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934005d90 con 0x7f494015aa40 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49400b2c70 con 0x7f494015aa40 2024-05-08T20:56:35.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49340070d0 con 0x7f494015aa40 2024-05-08T20:56:35.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934007440 con 0x7f494015aa40 2024-05-08T20:56:35.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.724+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49400cc740 con 0x7f494015aa40 2024-05-08T20:56:35.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.728+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49400b3190 con 0x7f494015aa40 2024-05-08T20:56:35.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.728+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49340075a0 con 0x7f494015aa40 2024-05-08T20:56:35.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.728+0000 7f493e7fc700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f492c066730 0x7f492c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:35.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.728+0000 7f494587f700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f492c066730 0x7f492c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:35.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.728+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4934082f90 con 0x7f494015aa40 2024-05-08T20:56:35.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.732+0000 7f494587f700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f492c066730 0x7f492c068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4930000f80 tx=0x7f4930013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:35.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.736+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f49340b4cf0 con 0x7f494015aa40 2024-05-08T20:56:35.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49400aee30 con 0x7f494015aa40 2024-05-08T20:56:35.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f493e7fc700 1 -- 172.21.15.107:0/106338656 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49340170a0 con 0x7f494015aa40 2024-05-08T20:56:35.911 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f492c066730 msgr2=0x7f492c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f492c066730 0x7f492c068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4930000f80 tx=0x7f4930013000 comp rx=0 tx=0).stop 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 msgr2=0x7f494014ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 0x7f494014ca30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4934001eb0 tx=0x7f493400c860 comp rx=0 tx=0).stop 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 shutdown_connections 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f494015e530 0x7f494014ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f494015aa40 0x7f494014ca30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f492c066730 0x7f492c068bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 --2- 172.21.15.107:0/106338656 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f49401544a0 0x7f49400b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:35.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 >> 172.21.15.107:0/106338656 conn(0x7f49400b1a60 msgr2=0x7f494015a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:35.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 shutdown_connections 2024-05-08T20:56:35.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:35.904+0000 7f4946881700 1 -- 172.21.15.107:0/106338656 wait complete. 2024-05-08T20:56:35.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:36.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 Processor -- start 2024-05-08T20:56:36.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- start start 2024-05-08T20:56:36.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe3900d1690 0x7fe3900d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900d1fb0 con 0x7fe3900cf6e0 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3900d3e50 con 0x7fe3900d1690 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900ce870 con 0x7fe3900d0f20 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe3900d1690 0x7fe3900d37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe3900d1690 0x7fe3900d37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38208/0 (socket says 172.21.15.107:38208) 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 -- 172.21.15.107:0/221100071 learned_addr learned my addr 172.21.15.107:0/221100071 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:36.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe39666d700 1 --1- 172.21.15.107:0/221100071 >> v1:172.21.15.107:6789/0 conn(0x7fe3900cf6e0 0x7fe3900cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57326/0 (socket says 172.21.15.107:57326) 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe39566b700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 -- 172.21.15.107:0/221100071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 msgr2=0x7fe3900d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 -- 172.21.15.107:0/221100071 >> v1:172.21.15.107:6789/0 conn(0x7fe3900cf6e0 legacy=0x7fe3900cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe394e6a700 1 -- 172.21.15.107:0/221100071 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903540082 0 0) 0x7fe3900d1fb0 con 0x7fe3900cf6e0 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 -- 172.21.15.107:0/221100071 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900ceb50 con 0x7fe3900d1690 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe39566b700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:36.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe395e6c700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900d37c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009910 tx=0x7fe38c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9c027fd86297da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:36.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe394e6a700 1 -- 172.21.15.107:0/221100071 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00ba60 con 0x7fe3900d1690 2024-05-08T20:56:36.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe394e6a700 1 -- 172.21.15.107:0/221100071 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00bbc0 con 0x7fe3900d1690 2024-05-08T20:56:36.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe394e6a700 1 -- 172.21.15.107:0/221100071 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c009e60 con 0x7fe3900d1690 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- 172.21.15.107:0/221100071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 msgr2=0x7fe3900d37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900d37c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009910 tx=0x7fe38c009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- 172.21.15.107:0/221100071 shutdown_connections 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 --2- 172.21.15.107:0/221100071 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900d37c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- 172.21.15.107:0/221100071 >> 172.21.15.107:0/221100071 conn(0x7fe39009c3c0 msgr2=0x7fe3900d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- 172.21.15.107:0/221100071 shutdown_connections 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.032+0000 7fe396e6e700 1 -- 172.21.15.107:0/221100071 wait complete. 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 Processor -- start 2024-05-08T20:56:36.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 -- start start 2024-05-08T20:56:36.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900cf6e0 0x7fe39015f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:36.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:36.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:36.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900cb530 con 0x7fe3900d1690 2024-05-08T20:56:36.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39015fb40 con 0x7fe3900cf6e0 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe396e6e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39015fe20 con 0x7fe3900d0f20 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38224/0 (socket says 172.21.15.107:38224) 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 -- 172.21.15.107:0/1913625690 learned_addr learned my addr 172.21.15.107:0/1913625690 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe395e6c700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900cf6e0 0x7fe39015f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39566b700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 -- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 msgr2=0x7fe3900b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 -- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900cf6e0 msgr2=0x7fe39015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900cf6e0 0x7fe39015f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe39666d700 1 -- 172.21.15.107:0/1913625690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c009570 con 0x7fe3900d1690 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.036+0000 7fe395e6c700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900cf6e0 0x7fe39015f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:36.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe39666d700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900b87a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe38800cba0 tx=0x7fe38800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800ab80 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38800ad00 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe390160100 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388007310 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3900b8ce0 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900cb6a0 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe388007470 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe3867fc700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe374066730 0x7fe374068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe388083c70 con 0x7fe3900d1690 2024-05-08T20:56:36.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe395e6c700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe374066730 0x7fe374068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:36.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.040+0000 7fe395e6c700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe374066730 0x7fe374068bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009860 tx=0x7fe38c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:36.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.052+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe388051330 con 0x7fe3900d1690 2024-05-08T20:56:36.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.248+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3900684b0 con 0x7fe3900d1690 2024-05-08T20:56:36.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe3867fc700 1 -- 172.21.15.107:0/1913625690 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7fe388018090 con 0x7fe3900d1690 2024-05-08T20:56:36.258 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:36.258 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe374066730 msgr2=0x7fe374068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe374066730 0x7fe374068bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009860 tx=0x7fe38c008030 comp rx=0 tx=0).stop 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 msgr2=0x7fe3900b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900b87a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe38800cba0 tx=0x7fe38800cf60 comp rx=0 tx=0).stop 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 shutdown_connections 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3900d1690 0x7fe3900b87a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe374066730 0x7fe374068bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe3900d0f20 0x7fe3900b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 --2- 172.21.15.107:0/1913625690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe3900cf6e0 0x7fe39015f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 >> 172.21.15.107:0/1913625690 conn(0x7fe39009c3c0 msgr2=0x7fe39006bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:36.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 shutdown_connections 2024-05-08T20:56:36.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:36.252+0000 7fe396e6e700 1 -- 172.21.15.107:0/1913625690 wait complete. 2024-05-08T20:56:36.262 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 2 2024-05-08T20:56:38.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:38.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.388+0000 7fb705b28700 1 Processor -- start 2024-05-08T20:56:38.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.388+0000 7fb705b28700 1 -- start start 2024-05-08T20:56:38.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7001596a0 0x7fb70006b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb70006b8b0 0x7fb70006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70006bd10 con 0x7fb70006e2e0 2024-05-08T20:56:38.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70006d590 con 0x7fb70006b8b0 2024-05-08T20:56:38.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000b4940 con 0x7fb7001596a0 2024-05-08T20:56:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb70006b8b0 0x7fb70006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb70006b8b0 0x7fb70006dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40116/0 (socket says 172.21.15.107:40116) 2024-05-08T20:56:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2358302630 learned_addr learned my addr 172.21.15.107:0/2358302630 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:38.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb704b26700 1 --2- 172.21.15.107:0/2358302630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7001596a0 0x7fb70006b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2358302630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7001596a0 msgr2=0x7fb70006b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:38.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 --2- 172.21.15.107:0/2358302630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7001596a0 0x7fb70006b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2358302630 >> v1:172.21.15.195:6789/0 conn(0x7fb70006e2e0 legacy=0x7fb7000b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2358302630 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70006e770 con 0x7fb70006b8b0 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f7fff700 1 --2- 172.21.15.107:0/2358302630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006b8b0 0x7fb70006dda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009910 tx=0x7fb6f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b525a078a16d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f77fe700 1 -- 172.21.15.107:0/2358302630 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0011830 con 0x7fb70006b8b0 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f77fe700 1 -- 172.21.15.107:0/2358302630 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0011990 con 0x7fb70006b8b0 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb6f77fe700 1 -- 172.21.15.107:0/2358302630 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0011d40 con 0x7fb70006b8b0 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- 172.21.15.107:0/2358302630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006b8b0 msgr2=0x7fb70006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 --2- 172.21.15.107:0/2358302630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006b8b0 0x7fb70006dda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009910 tx=0x7fb6f0009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- 172.21.15.107:0/2358302630 shutdown_connections 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 --2- 172.21.15.107:0/2358302630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006b8b0 0x7fb70006dda0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 --2- 172.21.15.107:0/2358302630 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb7001596a0 0x7fb70006b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- 172.21.15.107:0/2358302630 >> 172.21.15.107:0/2358302630 conn(0x7fb700070960 msgr2=0x7fb700070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- 172.21.15.107:0/2358302630 shutdown_connections 2024-05-08T20:56:38.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.392+0000 7fb705b28700 1 -- 172.21.15.107:0/2358302630 wait complete. 2024-05-08T20:56:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 Processor -- start 2024-05-08T20:56:38.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 -- start start 2024-05-08T20:56:38.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb70006b8b0 0x7fb70013b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 0x7fb70013bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7001596a0 0x7fb700152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb700151c50 con 0x7fb70006e2e0 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70013b5f0 con 0x7fb7001596a0 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705b28700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb700150fd0 con 0x7fb70006b8b0 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 0x7fb70013bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 0x7fb70013bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40130/0 (socket says 172.21.15.107:40130) 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2235342151 learned_addr learned my addr 172.21.15.107:0/2235342151 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb704b26700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb70006b8b0 0x7fb70013b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705327700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7001596a0 0x7fb700152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb70006b8b0 msgr2=0x7fb70013b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb70006b8b0 0x7fb70013b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7001596a0 msgr2=0x7fb700152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7001596a0 0x7fb700152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 -- 172.21.15.107:0/2235342151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f0009570 con 0x7fb70006e2e0 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb705327700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7001596a0 0x7fb700152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.396+0000 7fb6f7fff700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 0x7fb70013bb10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009c60 tx=0x7fb6f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0004480 con 0x7fb70006e2e0 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f001f070 con 0x7fb70006e2e0 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7001512b0 con 0x7fb70006e2e0 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0003900 con 0x7fb70006e2e0 2024-05-08T20:56:38.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb700151870 con 0x7fb70006e2e0 2024-05-08T20:56:38.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb700151a00 con 0x7fb70006e2e0 2024-05-08T20:56:38.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6f0021030 con 0x7fb70006e2e0 2024-05-08T20:56:38.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb6f57fa700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb6ec066730 0x7fb6ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb6f00851f0 con 0x7fb70006e2e0 2024-05-08T20:56:38.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.400+0000 7fb704b26700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb6ec066730 0x7fb6ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.404+0000 7fb704b26700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb6ec066730 0x7fb6ec068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009ae0 tx=0x7fb6fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:38.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.408+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb6f0052940 con 0x7fb70006e2e0 2024-05-08T20:56:38.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb700151d90 con 0x7fb70006e2e0 2024-05-08T20:56:38.623 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb6f57fa700 1 -- 172.21.15.107:0/2235342151 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7fb6f0015de0 con 0x7fb70006e2e0 2024-05-08T20:56:38.624 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:38.624 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb6ec066730 msgr2=0x7fb6ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb705b28700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb6ec066730 0x7fb6ec068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009ae0 tx=0x7fb6fc008040 comp rx=0 tx=0).stop 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 msgr2=0x7fb70013bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb705b28700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 0x7fb70013bb10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009c60 tx=0x7fb6f0004770 comp rx=0 tx=0).stop 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.616+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 shutdown_connections 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7001596a0 0x7fb700152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb70006e2e0 0x7fb70013bb10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb6ec066730 0x7fb6ec068bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 --2- 172.21.15.107:0/2235342151 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb70006b8b0 0x7fb70013b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 >> 172.21.15.107:0/2235342151 conn(0x7fb700070960 msgr2=0x7fb70015bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:38.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 shutdown_connections 2024-05-08T20:56:38.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.620+0000 7fb705b28700 1 -- 172.21.15.107:0/2235342151 wait complete. 2024-05-08T20:56:38.627 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 3 2024-05-08T20:56:38.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 Processor -- start 2024-05-08T20:56:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 -- start start 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f18cc0cf980 0x7f18cc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18cc0cddf0 0x7f18cc0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc15e830 con 0x7f18cc160de0 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0d02a0 con 0x7f18cc0cddf0 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d158c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0ce2d0 con 0x7f18cc0cf980 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18cc0cddf0 0x7f18cc0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18cc0cddf0 0x7f18cc0cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40132/0 (socket says 172.21.15.107:40132) 2024-05-08T20:56:38.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18d0d8b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f18cc160de0 0x7f18cc1611f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55608/0 (socket says 172.21.15.107:55608) 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 -- 172.21.15.107:0/3950558374 learned_addr learned my addr 172.21.15.107:0/3950558374 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cbfff700 1 --2- 172.21.15.107:0/3950558374 >> v2:172.21.15.195:3300/0 conn(0x7f18cc0cf980 0x7f18cc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 -- 172.21.15.107:0/3950558374 >> v2:172.21.15.195:3300/0 conn(0x7f18cc0cf980 msgr2=0x7f18cc15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 --2- 172.21.15.107:0/3950558374 >> v2:172.21.15.195:3300/0 conn(0x7f18cc0cf980 0x7f18cc15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 -- 172.21.15.107:0/3950558374 >> v1:172.21.15.107:6789/0 conn(0x7f18cc160de0 legacy=0x7f18cc1611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 -- 172.21.15.107:0/3950558374 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0ce5b0 con 0x7f18cc0cddf0 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18cb7fe700 1 --2- 172.21.15.107:0/3950558374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc0cddf0 0x7f18cc0cfd60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18cc08bf30 tx=0x7f18b4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66a5d07885d7927 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18caffd700 1 -- 172.21.15.107:0/3950558374 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4011830 con 0x7f18cc0cddf0 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18caffd700 1 -- 172.21.15.107:0/3950558374 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4011990 con 0x7f18cc0cddf0 2024-05-08T20:56:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.744+0000 7f18caffd700 1 -- 172.21.15.107:0/3950558374 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4011d20 con 0x7f18cc0cddf0 2024-05-08T20:56:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- 172.21.15.107:0/3950558374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc0cddf0 msgr2=0x7f18cc0cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 --2- 172.21.15.107:0/3950558374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc0cddf0 0x7f18cc0cfd60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18cc08bf30 tx=0x7f18b4009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- 172.21.15.107:0/3950558374 shutdown_connections 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 --2- 172.21.15.107:0/3950558374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc0cddf0 0x7f18cc0cfd60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 --2- 172.21.15.107:0/3950558374 >> v2:172.21.15.195:3300/0 conn(0x7f18cc0cf980 0x7f18cc15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- 172.21.15.107:0/3950558374 >> 172.21.15.107:0/3950558374 conn(0x7f18cc09c370 msgr2=0x7f18cc0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- 172.21.15.107:0/3950558374 shutdown_connections 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- 172.21.15.107:0/3950558374 wait complete. 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 Processor -- start 2024-05-08T20:56:38.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- start start 2024-05-08T20:56:38.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18cc0cf980 0x7f18cc156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 0x7f18cc157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18cc159730 0x7f18cc157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0cb130 con 0x7f18cc160de0 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc159bf0 con 0x7f18cc0cf980 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.748+0000 7f18d158c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc159ed0 con 0x7f18cc159730 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 0x7f18cc157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 0x7f18cc157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40140/0 (socket says 172.21.15.107:40140) 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 -- 172.21.15.107:0/2177838953 learned_addr learned my addr 172.21.15.107:0/2177838953 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18d0d8b700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18cc159730 0x7f18cc157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cbfff700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18cc0cf980 0x7f18cc156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 -- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18cc159730 msgr2=0x7f18cc157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18cc159730 0x7f18cc157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 -- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18cc0cf980 msgr2=0x7f18cc156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18cc0cf980 0x7f18cc156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 -- 172.21.15.107:0/2177838953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009570 con 0x7f18cc160de0 2024-05-08T20:56:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18cb7fe700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 0x7f18cc157610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f18b4013000 tx=0x7f18b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40044d0 con 0x7f18cc160de0 2024-05-08T20:56:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b401f070 con 0x7f18cc160de0 2024-05-08T20:56:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc0cadc0 con 0x7f18cc160de0 2024-05-08T20:56:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b40038c0 con 0x7f18cc160de0 2024-05-08T20:56:38.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1569a0 con 0x7f18cc160de0 2024-05-08T20:56:38.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0caf50 con 0x7f18cc160de0 2024-05-08T20:56:38.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.752+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18b4003a20 con 0x7f18cc160de0 2024-05-08T20:56:38.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.756+0000 7f18c8ff9700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f18ac066730 0x7f18ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:38.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.756+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f18b4021070 con 0x7f18cc160de0 2024-05-08T20:56:38.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.756+0000 7f18cbfff700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f18ac066730 0x7f18ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:38.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.756+0000 7f18cbfff700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f18ac066730 0x7f18ac068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0113e0 tx=0x7f18bc00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:38.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.760+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f18b4052930 con 0x7f18cc160de0 2024-05-08T20:56:38.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.928+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18cc0d3900 con 0x7f18cc160de0 2024-05-08T20:56:38.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18c8ff9700 1 -- 172.21.15.107:0/2177838953 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f18b4055f50 con 0x7f18cc160de0 2024-05-08T20:56:38.940 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:38.940 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":16,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:31.258613+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:38.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f18ac066730 msgr2=0x7f18ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f18ac066730 0x7f18ac068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0113e0 tx=0x7f18bc00b040 comp rx=0 tx=0).stop 2024-05-08T20:56:38.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 msgr2=0x7f18cc157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:38.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 0x7f18cc157610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f18b4013000 tx=0x7f18b4004770 comp rx=0 tx=0).stop 2024-05-08T20:56:38.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 shutdown_connections 2024-05-08T20:56:38.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f18ac066730 0x7f18ac068bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18cc159730 0x7f18cc157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18cc160de0 0x7f18cc157610 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.932+0000 7f18d158c700 1 --2- 172.21.15.107:0/2177838953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18cc0cf980 0x7f18cc156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:38.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.936+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 >> 172.21.15.107:0/2177838953 conn(0x7f18cc09c370 msgr2=0x7f18cc15f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:38.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.936+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 shutdown_connections 2024-05-08T20:56:38.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:38.936+0000 7f18d158c700 1 -- 172.21.15.107:0/2177838953 wait complete. 2024-05-08T20:56:38.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:56:38.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:56:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c359e700 1 Processor -- start 2024-05-08T20:56:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c359e700 1 -- start start 2024-05-08T20:56:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415cfa0 0x7f72c40b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c359e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c4161940 con 0x7f72c406aa70 2024-05-08T20:56:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c359e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40af1f0 con 0x7f72c40aed90 2024-05-08T20:56:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4160d30 con 0x7f72c415cfa0 2024-05-08T20:56:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c2d9d700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f72c406aa70 0x7f72c406d840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55624/0 (socket says 172.21.15.107:55624) 2024-05-08T20:56:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c2d9d700 1 -- 172.21.15.107:0/4272396355 learned_addr learned my addr 172.21.15.107:0/4272396355 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:39.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c259c700 1 --2- 172.21.15.107:0/4272396355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415cfa0 0x7f72c40b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c159a700 1 -- 172.21.15.107:0/4272396355 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220666178 0 0) 0x7f72c4161940 con 0x7f72c406aa70 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c159a700 1 -- 172.21.15.107:0/4272396355 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac0035d0 con 0x7f72c406aa70 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c159a700 1 -- 172.21.15.107:0/4272396355 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243809799 0 0) 0x7f72c40af1f0 con 0x7f72c40aed90 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c259c700 1 -- 172.21.15.107:0/4272396355 >> v1:172.21.15.195:6789/0 conn(0x7f72c40aed90 legacy=0x7f72c406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c259c700 1 -- 172.21.15.107:0/4272396355 >> v1:172.21.15.107:6789/0 conn(0x7f72c406aa70 legacy=0x7f72c406d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c259c700 1 -- 172.21.15.107:0/4272396355 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4161010 con 0x7f72c415cfa0 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c259c700 1 --2- 172.21.15.107:0/4272396355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415cfa0 0x7f72c40b2e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009880 tx=0x7f72b4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1855fc5b0931695 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c159a700 1 -- 172.21.15.107:0/4272396355 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4011830 con 0x7f72c415cfa0 2024-05-08T20:56:39.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c159a700 1 -- 172.21.15.107:0/4272396355 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4011990 con 0x7f72c415cfa0 2024-05-08T20:56:39.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.068+0000 7f72c159a700 1 -- 172.21.15.107:0/4272396355 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4011d00 con 0x7f72c415cfa0 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 -- 172.21.15.107:0/4272396355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415cfa0 msgr2=0x7f72c40b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 --2- 172.21.15.107:0/4272396355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415cfa0 0x7f72c40b2e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009880 tx=0x7f72b4009b90 comp rx=0 tx=0).stop 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 -- 172.21.15.107:0/4272396355 shutdown_connections 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 --2- 172.21.15.107:0/4272396355 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415cfa0 0x7f72c40b2e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 -- 172.21.15.107:0/4272396355 >> 172.21.15.107:0/4272396355 conn(0x7f72c406b470 msgr2=0x7f72c406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 -- 172.21.15.107:0/4272396355 shutdown_connections 2024-05-08T20:56:39.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 -- 172.21.15.107:0/4272396355 wait complete. 2024-05-08T20:56:39.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 Processor -- start 2024-05-08T20:56:39.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.072+0000 7f72c359e700 1 -- start start 2024-05-08T20:56:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 0x7f72c41439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c40aed90 0x7f72c41440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c415cfa0 0x7f72c41f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c415f1a0 con 0x7f72c406aa70 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c41f6fb0 con 0x7f72c415cfa0 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c415e800 con 0x7f72c40aed90 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 0x7f72c41439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 0x7f72c41439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40152/0 (socket says 172.21.15.107:40152) 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 -- 172.21.15.107:0/590505197 learned_addr learned my addr 172.21.15.107:0/590505197 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c1d9b700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c40aed90 0x7f72c41440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c2d9d700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c415cfa0 0x7f72c41f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 -- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c40aed90 msgr2=0x7f72c41440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c40aed90 0x7f72c41440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 -- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c415cfa0 msgr2=0x7f72c41f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c415cfa0 0x7f72c41f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 -- 172.21.15.107:0/590505197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40094b0 con 0x7f72c406aa70 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c2d9d700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c415cfa0 0x7f72c41f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c259c700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 0x7f72c41439c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72b40090b0 tx=0x7f72b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4004600 con 0x7f72c406aa70 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b40036c0 con 0x7f72c406aa70 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c415eae0 con 0x7f72c406aa70 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4003a50 con 0x7f72c406aa70 2024-05-08T20:56:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c4144630 con 0x7f72c406aa70 2024-05-08T20:56:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c40672a0 con 0x7f72c406aa70 2024-05-08T20:56:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.076+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72b4003bb0 con 0x7f72c406aa70 2024-05-08T20:56:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.080+0000 7f72b2ffd700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.080+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f72b40855d0 con 0x7f72c406aa70 2024-05-08T20:56:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.080+0000 7f72c1d9b700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.080+0000 7f72c1d9b700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72c4160810 tx=0x7f72b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.088+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f72b4052da0 con 0x7f72c406aa70 2024-05-08T20:56:39.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.252+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72c406d620 con 0x7f72c406aa70 2024-05-08T20:56:39.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72b2ffd700 1 -- 172.21.15.107:0/590505197 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72b4003e60 con 0x7f72c406aa70 2024-05-08T20:56:39.265 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T20:56:39.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 msgr2=0x7f72a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72c4160810 tx=0x7f72b8009040 comp rx=0 tx=0).stop 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 msgr2=0x7f72c41439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 0x7f72c41439c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f72b40090b0 tx=0x7f72b4004770 comp rx=0 tx=0).stop 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 shutdown_connections 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c415cfa0 0x7f72c41f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c40aed90 0x7f72c41440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 --2- 172.21.15.107:0/590505197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c406aa70 0x7f72c41439c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 >> 172.21.15.107:0/590505197 conn(0x7f72c406b470 msgr2=0x7f72c40adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 shutdown_connections 2024-05-08T20:56:39.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.256+0000 7f72c359e700 1 -- 172.21.15.107:0/590505197 wait complete. 2024-05-08T20:56:39.284 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T20:56:39.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 Processor -- start 2024-05-08T20:56:39.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 -- start start 2024-05-08T20:56:39.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe4c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbe4c0b2ea0 0x7fbe4c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4c0d3c20 con 0x7fbe4c0d1690 2024-05-08T20:56:39.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4c0d3e50 con 0x7fbe4c0b2ea0 2024-05-08T20:56:39.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe508f3700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0d1460 con 0x7fbe4c0d37c0 2024-05-08T20:56:39.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe4ad9d700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbe4c0d1690 0x7fbe4c0d1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55630/0 (socket says 172.21.15.107:55630) 2024-05-08T20:56:39.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe4ad9d700 1 -- 172.21.15.107:0/2822059912 learned_addr learned my addr 172.21.15.107:0/2822059912 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2822059912 >> v2:172.21.15.195:3300/0 conn(0x7fbe4c0b2ea0 0x7fbe4c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe4a59c700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe4c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264249136 0 0) 0x7fbe4c0d3c20 con 0x7fbe4c0d1690 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe340035d0 con 0x7fbe4c0d1690 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 999255841 0 0) 0x7fbe340035d0 con 0x7fbe4c0d1690 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 msgr2=0x7fbe4c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe4c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 >> v2:172.21.15.195:3300/0 conn(0x7fbe4c0b2ea0 msgr2=0x7fbe4c0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 --2- 172.21.15.107:0/2822059912 >> v2:172.21.15.195:3300/0 conn(0x7fbe4c0b2ea0 0x7fbe4c0b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0ce870 con 0x7fbe4c0d1690 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7fbe440019f0 con 0x7fbe4c0d1690 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 >> v1:172.21.15.107:6789/0 conn(0x7fbe4c0d1690 legacy=0x7fbe4c0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe34003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe34003fa0 0x7fbe34004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe34004db0 0x7fbe34005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0d3e50 con 0x7fbe34004db0 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0d1460 con 0x7fbe34003fa0 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.408+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3400ba30 con 0x7fbe4c0d37c0 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4ad9d700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe34003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe34004db0 0x7fbe34005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4a59c700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe34003fa0 0x7fbe34004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 msgr2=0x7fbe34003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe34003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe34003fa0 msgr2=0x7fbe34004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe34003fa0 0x7fbe34004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2822059912 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe340035d0 con 0x7fbe34004db0 2024-05-08T20:56:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4ad9d700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0d37c0 0x7fbe34003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:39.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe34004db0 0x7fbe34005230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009b70 tx=0x7fbe340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6e7276ba81744c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00e660 con 0x7fbe34004db0 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00e7c0 con 0x7fbe34004db0 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe49d9b700 1 -- 172.21.15.107:0/2822059912 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00eb30 con 0x7fbe34004db0 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe508f3700 1 -- 172.21.15.107:0/2822059912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe34004db0 msgr2=0x7fbe34005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2822059912 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe34004db0 0x7fbe34005230 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009b70 tx=0x7fbe340058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2822059912 reap_dead start 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe508f3700 1 -- 172.21.15.107:0/2822059912 shutdown_connections 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe508f3700 1 -- 172.21.15.107:0/2822059912 >> 172.21.15.107:0/2822059912 conn(0x7fbe4c09c3c0 msgr2=0x7fbe4c0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe508f3700 1 -- 172.21.15.107:0/2822059912 shutdown_connections 2024-05-08T20:56:39.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.412+0000 7fbe508f3700 1 -- 172.21.15.107:0/2822059912 wait complete. 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.416+0000 7fbe508f3700 1 Processor -- start 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.416+0000 7fbe508f3700 1 -- start start 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe4c0b7940 0x7fbe4c0b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0a0140 0x7fbe4c0a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 0x7fbe4c0cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0cce60 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c09d7b0 con 0x7fbe4c0b7940 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4c0a0b00 con 0x7fbe4c0a0140 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 0x7fbe4c0cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 0x7fbe4c0cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40164/0 (socket says 172.21.15.107:40164) 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2229143504 learned_addr learned my addr 172.21.15.107:0/2229143504 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4ad9d700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe4c0b7940 0x7fbe4c0b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4a59c700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0a0140 0x7fbe4c0a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0a0140 msgr2=0x7fbe4c0a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0a0140 0x7fbe4c0a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe4c0b7940 msgr2=0x7fbe4c0b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe4c0b7940 0x7fbe4c0b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 -- 172.21.15.107:0/2229143504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c0ccb80 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe4b59e700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 0x7fbe4c0cc2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c016000 tx=0x7fbe3c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00e660 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c0038c0 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4c14c5a0 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c003c70 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4c14cb60 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.420+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c14cd20 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.424+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe3c013470 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.424+0000 7fbe337fe700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbe38066730 0x7fbe38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.424+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbe3c085010 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.424+0000 7fbe4ad9d700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbe38066730 0x7fbe38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.424+0000 7fbe4ad9d700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbe38066730 0x7fbe38068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe440013b0 tx=0x7fbe44006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.428+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbe3c0563f0 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbe4c14c400 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe337fe700 1 -- 172.21.15.107:0/2229143504 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbe4c14c400 con 0x7fbe4c0cbe10 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-08T20:56:39.607 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-05-08T20:56:39.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbe38066730 msgr2=0x7fbe38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbe38066730 0x7fbe38068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbe440013b0 tx=0x7fbe44006040 comp rx=0 tx=0).stop 2024-05-08T20:56:39.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 msgr2=0x7fbe4c0cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 0x7fbe4c0cc2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c016000 tx=0x7fbe3c0047e0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 shutdown_connections 2024-05-08T20:56:39.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe4c0cbe10 0x7fbe4c0cc2c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbe38066730 0x7fbe38068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe4c0a0140 0x7fbe4c0a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 --2- 172.21.15.107:0/2229143504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe4c0b7940 0x7fbe4c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 >> 172.21.15.107:0/2229143504 conn(0x7fbe4c09c3c0 msgr2=0x7fbe4c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:39.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 shutdown_connections 2024-05-08T20:56:39.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.600+0000 7fbe508f3700 1 -- 172.21.15.107:0/2229143504 wait complete. 2024-05-08T20:56:39.622 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T20:56:39.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T20:56:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.732+0000 7f3d4759e700 1 Processor -- start 2024-05-08T20:56:39.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.732+0000 7f3d4759e700 1 -- start start 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4759e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d480b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4759e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480cdc20 con 0x7f3d480b3200 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4759e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d480ce1c0 con 0x7f3d480ce650 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4759e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d481610c0 con 0x7f3d4815d3d0 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d45d9b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f3d480b3200 0x7f3d480d0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55632/0 (socket says 172.21.15.107:55632) 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d45d9b700 1 -- 172.21.15.107:0/15024092 learned_addr learned my addr 172.21.15.107:0/15024092 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:39.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4659c700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d480b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945322431 0 0) 0x7f3d480cdc20 con 0x7f3d480b3200 2024-05-08T20:56:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d300035d0 con 0x7f3d480b3200 2024-05-08T20:56:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335413615 0 0) 0x7f3d480ce1c0 con 0x7f3d480ce650 2024-05-08T20:56:39.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d480cdc20 con 0x7f3d480ce650 2024-05-08T20:56:39.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414150024 0 0) 0x7f3d300035d0 con 0x7f3d480b3200 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 msgr2=0x7f3d480b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d480b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 >> v1:172.21.15.195:6789/0 conn(0x7f3d480ce650 legacy=0x7f3d480ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480d1ac0 con 0x7f3d480b3200 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4659c700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d480b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7f3d38001670 con 0x7f3d480b3200 2024-05-08T20:56:39.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 >> v1:172.21.15.107:6789/0 conn(0x7f3d480b3200 legacy=0x7f3d480d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d30003be0 0x7f3d30003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d30004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d30004db0 0x7f3d30005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d481610c0 con 0x7f3d30004db0 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3000bae0 con 0x7f3d30003be0 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3000bc20 con 0x7f3d4815d3d0 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d30004db0 0x7f3d30005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4659c700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d30003be0 0x7f3d30003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d45d9b700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d30004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 -- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 msgr2=0x7f3d30004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d30004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 -- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d30003be0 msgr2=0x7f3d30003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d30003be0 0x7f3d30003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 -- 172.21.15.107:0/15024092 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0094b0 con 0x7f3d30004db0 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d45d9b700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d4815d3d0 0x7f3d30004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d46d9d700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d30004db0 0x7f3d30005230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c2f0 tx=0x7f3d300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca58f5fa03996850 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40001f30 con 0x7f3d30004db0 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000ce50 con 0x7f3d30004db0 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.736+0000 7f3d4559a700 1 -- 172.21.15.107:0/15024092 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40003c60 con 0x7f3d30004db0 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- 172.21.15.107:0/15024092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d30004db0 msgr2=0x7f3d30005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 --2- 172.21.15.107:0/15024092 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d30004db0 0x7f3d30005230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c2f0 tx=0x7f3d300058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d46d9d700 1 -- 172.21.15.107:0/15024092 reap_dead start 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- 172.21.15.107:0/15024092 shutdown_connections 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- 172.21.15.107:0/15024092 >> 172.21.15.107:0/15024092 conn(0x7f3d4808b000 msgr2=0x7f3d4809c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- 172.21.15.107:0/15024092 shutdown_connections 2024-05-08T20:56:39.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- 172.21.15.107:0/15024092 wait complete. 2024-05-08T20:56:39.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 Processor -- start 2024-05-08T20:56:39.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- start start 2024-05-08T20:56:39.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 0x7f3d4815e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d481603f0 0x7f3d4815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d4815c940 0x7f3d480ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4815cdc0 con 0x7f3d481f2b90 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480cbf00 con 0x7f3d4815c940 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.740+0000 7f3d4759e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480cca80 con 0x7f3d481603f0 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 0x7f3d4815e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 0x7f3d4815e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40176/0 (socket says 172.21.15.107:40176) 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 -- 172.21.15.107:0/2262328143 learned_addr learned my addr 172.21.15.107:0/2262328143 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d46d9d700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d4815c940 0x7f3d480ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d45d9b700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d481603f0 0x7f3d4815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 -- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d481603f0 msgr2=0x7f3d4815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d481603f0 0x7f3d4815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 -- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d4815c940 msgr2=0x7f3d480ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d4815c940 0x7f3d480ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:39.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 -- 172.21.15.107:0/2262328143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480cc150 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4659c700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 0x7f3d4815e1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c011d00 tx=0x7f3d3c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00fad0 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c00fc30 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d480cc430 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c014440 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4815e700 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d480672a0 con 0x7f3d481f2b90 2024-05-08T20:56:39.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.744+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d3c0145a0 con 0x7f3d481f2b90 2024-05-08T20:56:39.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.748+0000 7f3d36ffd700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d28066730 0x7f3d28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:39.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.748+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d3c0846b0 con 0x7f3d481f2b90 2024-05-08T20:56:39.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.748+0000 7f3d45d9b700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d28066730 0x7f3d28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:39.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.748+0000 7f3d45d9b700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d28066730 0x7f3d28068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d380048f0 tx=0x7f3d38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:39.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.752+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3d3c051d80 con 0x7f3d481f2b90 2024-05-08T20:56:39.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:39.924+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3d4815dfa0 con 0x7f3d481f2b90 2024-05-08T20:56:40.104 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:40.106 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:56:40.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.388+0000 7f3d36ffd700 1 -- 172.21.15.107:0/2262328143 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3d3c0553a0 con 0x7f3d481f2b90 2024-05-08T20:56:40.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d28066730 msgr2=0x7f3d28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:40.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d28066730 0x7f3d28068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d380048f0 tx=0x7f3d38009040 comp rx=0 tx=0).stop 2024-05-08T20:56:40.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 msgr2=0x7f3d4815e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:40.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 0x7f3d4815e1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c011d00 tx=0x7f3d3c00f520 comp rx=0 tx=0).stop 2024-05-08T20:56:40.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 shutdown_connections 2024-05-08T20:56:40.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3d4815c940 0x7f3d480ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3d28066730 0x7f3d28068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3d481603f0 0x7f3d4815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 --2- 172.21.15.107:0/2262328143 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3d481f2b90 0x7f3d4815e1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 >> 172.21.15.107:0/2262328143 conn(0x7f3d4808b000 msgr2=0x7f3d480b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 shutdown_connections 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.396+0000 7f3d4759e700 1 -- 172.21.15.107:0/2262328143 wait complete. 2024-05-08T20:56:40.404 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' created 2024-05-08T20:56:40.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T20:56:40.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.524+0000 7f2f84813700 1 Processor -- start 2024-05-08T20:56:40.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.524+0000 7f2f84813700 1 -- start start 2024-05-08T20:56:40.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.524+0000 7f2f84813700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f8015d560 0x7f2f800d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:40.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.524+0000 7f2f84813700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2f800d2f60 0x7f2f800d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:40.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800ce480 con 0x7f2f8015d180 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800d3950 con 0x7f2f8015d560 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800ce760 con 0x7f2f800d2f60 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f8015d560 0x7f2f800d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2f8015d560 0x7f2f800d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40180/0 (socket says 172.21.15.107:40180) 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 -- 172.21.15.107:0/3546285216 learned_addr learned my addr 172.21.15.107:0/3546285216 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7ffff700 1 --2- 172.21.15.107:0/3546285216 >> v2:172.21.15.195:3300/0 conn(0x7f2f800d2f60 0x7f2f800d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 -- 172.21.15.107:0/3546285216 >> v2:172.21.15.195:3300/0 conn(0x7f2f800d2f60 msgr2=0x7f2f800d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 --2- 172.21.15.107:0/3546285216 >> v2:172.21.15.195:3300/0 conn(0x7f2f800d2f60 0x7f2f800d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 -- 172.21.15.107:0/3546285216 >> v1:172.21.15.195:6789/0 conn(0x7f2f8015d180 legacy=0x7f2f800cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 -- 172.21.15.107:0/3546285216 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800cea40 con 0x7f2f8015d560 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7effd700 1 --2- 172.21.15.107:0/3546285216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800d1bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f800d28c0 tx=0x7f2f70009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65fbd30357f49c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:40.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7e7fc700 1 -- 172.21.15.107:0/3546285216 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70011830 con 0x7f2f8015d560 2024-05-08T20:56:40.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7e7fc700 1 -- 172.21.15.107:0/3546285216 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70011990 con 0x7f2f8015d560 2024-05-08T20:56:40.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f7e7fc700 1 -- 172.21.15.107:0/3546285216 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70011d20 con 0x7f2f8015d560 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- 172.21.15.107:0/3546285216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 msgr2=0x7f2f800d1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 --2- 172.21.15.107:0/3546285216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800d1bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f800d28c0 tx=0x7f2f70009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- 172.21.15.107:0/3546285216 shutdown_connections 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 --2- 172.21.15.107:0/3546285216 >> v2:172.21.15.195:3300/0 conn(0x7f2f800d2f60 0x7f2f800d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 --2- 172.21.15.107:0/3546285216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800d1bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- 172.21.15.107:0/3546285216 >> 172.21.15.107:0/3546285216 conn(0x7f2f8008c530 msgr2=0x7f2f8009c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- 172.21.15.107:0/3546285216 shutdown_connections 2024-05-08T20:56:40.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.528+0000 7f2f84813700 1 -- 172.21.15.107:0/3546285216 wait complete. 2024-05-08T20:56:40.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 Processor -- start 2024-05-08T20:56:40.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 -- start start 2024-05-08T20:56:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f800d2f60 0x7f2f80149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f8015d180 0x7f2f801f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801f74d0 con 0x7f2f8015d560 2024-05-08T20:56:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80149970 con 0x7f2f8015d180 2024-05-08T20:56:40.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f84813700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800c9260 con 0x7f2f800d2f60 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40188/0 (socket says 172.21.15.107:40188) 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 -- 172.21.15.107:0/1596650223 learned_addr learned my addr 172.21.15.107:0/1596650223 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7f7fe700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f800d2f60 0x7f2f80149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7effd700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f8015d180 0x7f2f801f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 -- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f800d2f60 msgr2=0x7f2f80149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f800d2f60 0x7f2f80149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 -- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f8015d180 msgr2=0x7f2f801f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f8015d180 0x7f2f801f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 -- 172.21.15.107:0/1596650223 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009570 con 0x7f2f8015d560 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.532+0000 7f2f7ffff700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800cff30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800efc0 tx=0x7f2f7800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800caa0 con 0x7f2f8015d560 2024-05-08T20:56:40.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800f040 con 0x7f2f8015d560 2024-05-08T20:56:40.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f800c9540 con 0x7f2f8015d560 2024-05-08T20:56:40.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800ce40 con 0x7f2f8015d560 2024-05-08T20:56:40.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80149320 con 0x7f2f8015d560 2024-05-08T20:56:40.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f800672a0 con 0x7f2f8015d560 2024-05-08T20:56:40.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f78014480 con 0x7f2f8015d560 2024-05-08T20:56:40.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f67fff700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2f6c066730 0x7f2f6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:40.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2f780846f0 con 0x7f2f8015d560 2024-05-08T20:56:40.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.536+0000 7f2f7f7fe700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2f6c066730 0x7f2f6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:40.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.540+0000 7f2f7f7fe700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2f6c066730 0x7f2f6c068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000f60 tx=0x7f2f74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:40.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.544+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2f78051ce0 con 0x7f2f8015d560 2024-05-08T20:56:40.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:40.716+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2f80149ab0 con 0x7f2f8015d560 2024-05-08T20:56:41.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.392+0000 7f2f67fff700 1 -- 172.21.15.107:0/1596650223 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2f78018020 con 0x7f2f8015d560 2024-05-08T20:56:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2f6c066730 msgr2=0x7f2f6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2f6c066730 0x7f2f6c068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f74000f60 tx=0x7f2f74009040 comp rx=0 tx=0).stop 2024-05-08T20:56:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 msgr2=0x7f2f800cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800cff30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800efc0 tx=0x7f2f7800c0c0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 shutdown_connections 2024-05-08T20:56:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2f8015d560 0x7f2f800cff30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2f8015d180 0x7f2f801f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2f6c066730 0x7f2f6c068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 --2- 172.21.15.107:0/1596650223 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2f800d2f60 0x7f2f80149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 >> 172.21.15.107:0/1596650223 conn(0x7f2f8008c530 msgr2=0x7f2f8006b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 shutdown_connections 2024-05-08T20:56:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.408+0000 7f2f84813700 1 -- 172.21.15.107:0/1596650223 wait complete. 2024-05-08T20:56:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' created 2024-05-08T20:56:41.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T20:56:41.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 Processor -- start 2024-05-08T20:56:41.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 -- start start 2024-05-08T20:56:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4bfc15ae10 0x7f4bfc0ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ead0 0x7f4bfc0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc06c7d0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc0ce9a0 con 0x7f4bfc15ae10 2024-05-08T20:56:41.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfb59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc06c4d0 con 0x7f4bfc15ead0 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfa59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4bfc15ae10 0x7f4bfc0ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfad9d700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4bfc0ce4f0 0x7f4bfc0b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55646/0 (socket says 172.21.15.107:55646) 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bfad9d700 1 -- 172.21.15.107:0/3553205620 learned_addr learned my addr 172.21.15.107:0/3553205620 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bf9d9b700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ead0 0x7f4bfc0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.536+0000 7f4bf959a700 1 -- 172.21.15.107:0/3553205620 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196486063 0 0) 0x7f4bfc06c7d0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bf959a700 1 -- 172.21.15.107:0/3553205620 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be80035d0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfa59c700 1 -- 172.21.15.107:0/3553205620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ead0 msgr2=0x7f4bfc0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfa59c700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ead0 0x7f4bfc0cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfa59c700 1 -- 172.21.15.107:0/3553205620 >> v1:172.21.15.107:6789/0 conn(0x7f4bfc0ce4f0 legacy=0x7f4bfc0b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bf959a700 1 -- 172.21.15.107:0/3553205620 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2193850928 0 0) 0x7f4be80035d0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfa59c700 1 -- 172.21.15.107:0/3553205620 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0acd90 con 0x7f4bfc15ae10 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bf9d9b700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ead0 0x7f4bfc0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:41.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfa59c700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc15ae10 0x7f4bfc0ac420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009850 tx=0x7f4bec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b794d7a43b624c8d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bf959a700 1 -- 172.21.15.107:0/3553205620 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40019f0 con 0x7f4bfc15ae10 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bf959a700 1 -- 172.21.15.107:0/3553205620 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec004030 con 0x7f4bfc15ae10 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bf959a700 1 -- 172.21.15.107:0/3553205620 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0043e0 con 0x7f4bfc15ae10 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 -- 172.21.15.107:0/3553205620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc15ae10 msgr2=0x7f4bfc0ac420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc15ae10 0x7f4bfc0ac420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009850 tx=0x7f4bec009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 -- 172.21.15.107:0/3553205620 shutdown_connections 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ead0 0x7f4bfc0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/3553205620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc15ae10 0x7f4bfc0ac420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 -- 172.21.15.107:0/3553205620 >> 172.21.15.107:0/3553205620 conn(0x7f4bfc0b0de0 msgr2=0x7f4bfc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 -- 172.21.15.107:0/3553205620 shutdown_connections 2024-05-08T20:56:41.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.540+0000 7f4bfb59e700 1 -- 172.21.15.107:0/3553205620 wait complete. 2024-05-08T20:56:41.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 Processor -- start 2024-05-08T20:56:41.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 -- start start 2024-05-08T20:56:41.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 0x7f4bfc14a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ae10 0x7f4bfc158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bfc15ead0 0x7f4bfc1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc14ad70 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc151380 con 0x7f4bfc15ead0 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfb59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc151660 con 0x7f4bfc15ae10 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 0x7f4bfc14a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 0x7f4bfc14a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40206/0 (socket says 172.21.15.107:40206) 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 -- 172.21.15.107:0/2224933814 learned_addr learned my addr 172.21.15.107:0/2224933814 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bf9d9b700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ae10 0x7f4bfc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfad9d700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bfc15ead0 0x7f4bfc1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 -- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ae10 msgr2=0x7f4bfc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ae10 0x7f4bfc158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 -- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bfc15ead0 msgr2=0x7f4bfc1f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bfc15ead0 0x7f4bfc1f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bfa59c700 1 -- 172.21.15.107:0/2224933814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40094b0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.544+0000 7f4bf9d9b700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ae10 0x7f4bfc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bfa59c700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 0x7f4bfc14a830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec011630 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec01f070 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0119f0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bec0094b0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1f43f0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc14aee0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bec011b50 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf2ffd700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4bdc066760 0x7f4bdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf9d9b700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4bdc066760 0x7f4bdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4bec021070 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.548+0000 7f4bf9d9b700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4bdc066760 0x7f4bdc068c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc1f42b0 tx=0x7f4be4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:41.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.556+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4bfc14aee0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.760+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4bfc14aeb0 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.776+0000 7f4bf2ffd700 1 -- 172.21.15.107:0/2224933814 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4bec02b020 con 0x7f4bfc0ce4f0 2024-05-08T20:56:41.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4bdc066760 msgr2=0x7f4bdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4bdc066760 0x7f4bdc068c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc1f42b0 tx=0x7f4be4008040 comp rx=0 tx=0).stop 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 msgr2=0x7f4bfc14a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 0x7f4bfc14a830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec004770 comp rx=0 tx=0).stop 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 shutdown_connections 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4bfc15ead0 0x7f4bfc1f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4bdc066760 0x7f4bdc068c20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4bfc15ae10 0x7f4bfc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 --2- 172.21.15.107:0/2224933814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bfc0ce4f0 0x7f4bfc14a830 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bec000c00 tx=0x7f4bec004770 comp rx=0 tx=0).stop 2024-05-08T20:56:41.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.784+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 >> 172.21.15.107:0/2224933814 conn(0x7f4bfc0b0de0 msgr2=0x7f4bfc155670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:41.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.796+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 shutdown_connections 2024-05-08T20:56:41.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.796+0000 7f4bfb59e700 1 -- 172.21.15.107:0/2224933814 wait complete. 2024-05-08T20:56:41.805 INFO:teuthology.orchestra.run.smithi107.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T20:56:41.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.912+0000 7f25b4f11700 1 Processor -- start 2024-05-08T20:56:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- start start 2024-05-08T20:56:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f25a80e3b40 0x7f25a80e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 0x7f25a80e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a8006150 0x7f25a8038ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a80e49a0 con 0x7f25a80e3b40 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a80540b0 con 0x7f25a80e0250 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80532f0 con 0x7f25a8006150 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f25a80e3b40 0x7f25a80e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25aeffd700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 0x7f25a80e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25affff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a8006150 0x7f25a8038ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f25a80e3b40 0x7f25a80e3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40222/0 (socket says 172.21.15.107:40222) 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25aeffd700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 0x7f25a80e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:57170/0 (socket says 172.21.15.107:57170) 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25aeffd700 1 -- 172.21.15.107:0/3656795481 learned_addr learned my addr 172.21.15.107:0/3656795481 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25affff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a8006150 0x7f25a8038ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:50008/0 (socket says 172.21.15.107:50008) 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 -- 172.21.15.107:0/3656795481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a8006150 msgr2=0x7f25a8038ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 --2- 172.21.15.107:0/3656795481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a8006150 0x7f25a8038ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 -- 172.21.15.107:0/3656795481 >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 msgr2=0x7f25a80e4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 --2- 172.21.15.107:0/3656795481 >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 0x7f25a80e4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 -- 172.21.15.107:0/3656795481 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80535d0 con 0x7f25a80e3b40 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25aeffd700 1 --2- 172.21.15.107:0/3656795481 >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 0x7f25a80e4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:41.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25af7fe700 1 --2- 172.21.15.107:0/3656795481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a80e3b40 0x7f25a80e3f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25a800d940 tx=0x7f25a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d22b0a04c6d78a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25ae7fc700 1 -- 172.21.15.107:0/3656795481 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4011830 con 0x7f25a80e3b40 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25ae7fc700 1 -- 172.21.15.107:0/3656795481 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4011990 con 0x7f25a80e3b40 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25ae7fc700 1 -- 172.21.15.107:0/3656795481 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4011d20 con 0x7f25a80e3b40 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- 172.21.15.107:0/3656795481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a80e3b40 msgr2=0x7f25a80e3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3656795481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a80e3b40 0x7f25a80e3f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25a800d940 tx=0x7f25a4009b30 comp rx=0 tx=0).stop 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- 172.21.15.107:0/3656795481 shutdown_connections 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3656795481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a8006150 0x7f25a8038ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3656795481 >> v2:172.21.15.195:3300/0 conn(0x7f25a80e0250 0x7f25a80e4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3656795481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a80e3b40 0x7f25a80e3f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- 172.21.15.107:0/3656795481 >> 172.21.15.107:0/3656795481 conn(0x7f25a8054b70 msgr2=0x7f25a8054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- 172.21.15.107:0/3656795481 shutdown_connections 2024-05-08T20:56:41.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.916+0000 7f25b4f11700 1 -- 172.21.15.107:0/3656795481 wait complete. 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 Processor -- start 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 -- start start 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 0x7f25a804c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a80e3b40 0x7f25a80d3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25a80e1a90 0x7f25a80e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80d35a0 con 0x7f25a8006150 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a804d4a0 con 0x7f25a80e1a90 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25b4f11700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80e1f40 con 0x7f25a80e3b40 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 0x7f25a804c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 0x7f25a804c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40238/0 (socket says 172.21.15.107:40238) 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 -- 172.21.15.107:0/3291365195 learned_addr learned my addr 172.21.15.107:0/3291365195 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:41.929 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25aeffd700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a80e3b40 0x7f25a80d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25affff700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25a80e1a90 0x7f25a80e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 -- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a80e3b40 msgr2=0x7f25a80d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a80e3b40 0x7f25a80d3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 -- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25a80e1a90 msgr2=0x7f25a80e2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25a80e1a90 0x7f25a80e2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 -- 172.21.15.107:0/3291365195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a000b810 con 0x7f25a8006150 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.920+0000 7f25af7fe700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 0x7f25a804c7e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25a4014040 tx=0x7f25a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4004590 con 0x7f25a8006150 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a401e070 con 0x7f25a8006150 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a40094b0 con 0x7f25a8006150 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4003900 con 0x7f25a8006150 2024-05-08T20:56:41.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a804d1c0 con 0x7f25a8006150 2024-05-08T20:56:41.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8005440 con 0x7f25a8006150 2024-05-08T20:56:41.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25a4003a60 con 0x7f25a8006150 2024-05-08T20:56:41.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f2597fff700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f259c066760 0x7f259c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:41.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.924+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25a4084e60 con 0x7f25a8006150 2024-05-08T20:56:41.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.928+0000 7f25aeffd700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f259c066760 0x7f259c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:41.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.928+0000 7f25aeffd700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f259c066760 0x7f259c068c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25a8007900 tx=0x7f25a000b4f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:41.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:41.932+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f25a40521c0 con 0x7f25a8006150 2024-05-08T20:56:42.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.100+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25a80e28d0 con 0x7f25a8006150 2024-05-08T20:56:42.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.104+0000 7f2597fff700 1 -- 172.21.15.107:0/3291365195 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7f25a4020090 con 0x7f25a8006150 2024-05-08T20:56:42.112 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:42.112 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":19,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:41.768309+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f259c066760 msgr2=0x7f259c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f259c066760 0x7f259c068c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25a8007900 tx=0x7f25a000b4f0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 msgr2=0x7f25a804c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 0x7f25a804c7e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25a4014040 tx=0x7f25a4004770 comp rx=0 tx=0).stop 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 shutdown_connections 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25a80e1a90 0x7f25a80e2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f259c066760 0x7f259c068c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f25a80e3b40 0x7f25a80d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 --2- 172.21.15.107:0/3291365195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f25a8006150 0x7f25a804c7e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 >> 172.21.15.107:0/3291365195 conn(0x7f25a8054b70 msgr2=0x7f25a8038e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:42.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 shutdown_connections 2024-05-08T20:56:42.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.108+0000 7f25b4f11700 1 -- 172.21.15.107:0/3291365195 wait complete. 2024-05-08T20:56:42.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:42.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25fe00700 1 Processor -- start 2024-05-08T20:56:42.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25fe00700 1 -- start start 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25fe00700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff2580b5300 0x7ff2580d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25fe00700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580d1b30 con 0x7ff25815d640 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25fe00700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2580d1e10 con 0x7ff2580ce570 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25fe00700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2580d20f0 con 0x7ff2580b5300 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25db9c700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff25815d640 0x7ff2580d1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55658/0 (socket says 172.21.15.107:55658) 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25db9c700 1 -- 172.21.15.107:0/1220744153 learned_addr learned my addr 172.21.15.107:0/1220744153 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:42.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25e39d700 1 --2- 172.21.15.107:0/1220744153 >> v2:172.21.15.195:3300/0 conn(0x7ff2580b5300 0x7ff2580d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25cb9a700 1 -- 172.21.15.107:0/1220744153 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823813084 0 0) 0x7ff2580d1b30 con 0x7ff25815d640 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25cb9a700 1 -- 172.21.15.107:0/1220744153 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2440035d0 con 0x7ff25815d640 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25e39d700 1 -- 172.21.15.107:0/1220744153 >> v1:172.21.15.195:6789/0 conn(0x7ff2580ce570 legacy=0x7ff2580b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25e39d700 1 -- 172.21.15.107:0/1220744153 >> v1:172.21.15.107:6789/0 conn(0x7ff25815d640 legacy=0x7ff2580d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25e39d700 1 -- 172.21.15.107:0/1220744153 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2580d23d0 con 0x7ff2580b5300 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25e39d700 1 --2- 172.21.15.107:0/1220744153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2580b5300 0x7ff2580d2bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff250009850 tx=0x7ff250009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=517137dafa509071 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25cb9a700 1 -- 172.21.15.107:0/1220744153 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250011830 con 0x7ff2580b5300 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25cb9a700 1 -- 172.21.15.107:0/1220744153 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff250011990 con 0x7ff2580b5300 2024-05-08T20:56:42.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.236+0000 7ff25cb9a700 1 -- 172.21.15.107:0/1220744153 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff250011d40 con 0x7ff2580b5300 2024-05-08T20:56:42.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 -- 172.21.15.107:0/1220744153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2580b5300 msgr2=0x7ff2580d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 --2- 172.21.15.107:0/1220744153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2580b5300 0x7ff2580d2bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff250009850 tx=0x7ff250009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:42.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 -- 172.21.15.107:0/1220744153 shutdown_connections 2024-05-08T20:56:42.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 --2- 172.21.15.107:0/1220744153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2580b5300 0x7ff2580d2bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 -- 172.21.15.107:0/1220744153 >> 172.21.15.107:0/1220744153 conn(0x7ff258073cf0 msgr2=0x7ff2580cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:42.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 -- 172.21.15.107:0/1220744153 shutdown_connections 2024-05-08T20:56:42.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 -- 172.21.15.107:0/1220744153 wait complete. 2024-05-08T20:56:42.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 Processor -- start 2024-05-08T20:56:42.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.240+0000 7ff25fe00700 1 -- start start 2024-05-08T20:56:42.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2580b5300 0x7ff2580c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 0x7ff25815f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff25815d640 0x7ff2580b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2581608f0 con 0x7ff2580ce570 2024-05-08T20:56:42.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff258160330 con 0x7ff25815d640 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff258160610 con 0x7ff2580b5300 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 0x7ff25815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 0x7ff25815f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40242/0 (socket says 172.21.15.107:40242) 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 -- 172.21.15.107:0/2769529383 learned_addr learned my addr 172.21.15.107:0/2769529383 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25e39d700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff25815d640 0x7ff2580b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25db9c700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2580b5300 0x7ff2580c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 -- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2580b5300 msgr2=0x7ff2580c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2580b5300 0x7ff2580c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 -- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff25815d640 msgr2=0x7ff2580b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff25815d640 0x7ff2580b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 -- 172.21.15.107:0/2769529383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2500094b0 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25e39d700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff25815d640 0x7ff2580b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25d39b700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 0x7ff25815f820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff25400cbd0 tx=0x7ff25400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254003c20 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff254003d80 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff258150100 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400abf0 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2580c9a90 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.244+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff240005310 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.248+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff25400ad50 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.248+0000 7ff24e7fc700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff23c066730 0x7ff23c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.248+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff254084190 con 0x7ff2580ce570 2024-05-08T20:56:42.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.248+0000 7ff25db9c700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff23c066730 0x7ff23c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.248+0000 7ff25db9c700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff23c066730 0x7ff23c068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2480011e0 tx=0x7ff248009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:42.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.256+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff254051590 con 0x7ff2580ce570 2024-05-08T20:56:42.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.424+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff240005890 con 0x7ff2580ce570 2024-05-08T20:56:42.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.424+0000 7ff24e7fc700 1 -- 172.21.15.107:0/2769529383 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7ff254001c90 con 0x7ff2580ce570 2024-05-08T20:56:42.434 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:42.434 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":19,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:41.768309+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff23c066730 msgr2=0x7ff23c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff23c066730 0x7ff23c068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff2480011e0 tx=0x7ff248009040 comp rx=0 tx=0).stop 2024-05-08T20:56:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 msgr2=0x7ff25815f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 0x7ff25815f820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff25400cbd0 tx=0x7ff25400cf90 comp rx=0 tx=0).stop 2024-05-08T20:56:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 shutdown_connections 2024-05-08T20:56:42.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff25815d640 0x7ff2580b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2580ce570 0x7ff25815f820 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff23c066730 0x7ff23c068bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 --2- 172.21.15.107:0/2769529383 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2580b5300 0x7ff2580c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 >> 172.21.15.107:0/2769529383 conn(0x7ff258073cf0 msgr2=0x7ff2580b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:42.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 shutdown_connections 2024-05-08T20:56:42.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.428+0000 7ff25fe00700 1 -- 172.21.15.107:0/2769529383 wait complete. 2024-05-08T20:56:42.460 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T20:56:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 Processor -- start 2024-05-08T20:56:42.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 -- start start 2024-05-08T20:56:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb8e415d640 0x7fb8e40ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb8e40d2bd0 0x7fb8e40d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40d1890 con 0x7fb8e40b4bf0 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40d1b30 con 0x7fb8e415d640 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ebc1e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40d1e10 con 0x7fb8e40d2bd0 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8e99ba700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb8e415d640 0x7fb8e40ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ea1bb700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb8e40b4bf0 0x7fb8e406b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55664/0 (socket says 172.21.15.107:55664) 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8ea1bb700 1 -- 172.21.15.107:0/539160850 learned_addr learned my addr 172.21.15.107:0/539160850 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8e91b9700 1 --2- 172.21.15.107:0/539160850 >> v2:172.21.15.195:3300/0 conn(0x7fb8e40d2bd0 0x7fb8e40d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8e89b8700 1 -- 172.21.15.107:0/539160850 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560389617 0 0) 0x7fb8e40d1890 con 0x7fb8e40b4bf0 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8e89b8700 1 -- 172.21.15.107:0/539160850 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d00035d0 con 0x7fb8e40b4bf0 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8e99ba700 1 -- 172.21.15.107:0/539160850 >> v2:172.21.15.195:3300/0 conn(0x7fb8e40d2bd0 msgr2=0x7fb8e40d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:42.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.572+0000 7fb8e99ba700 1 --2- 172.21.15.107:0/539160850 >> v2:172.21.15.195:3300/0 conn(0x7fb8e40d2bd0 0x7fb8e40d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8e99ba700 1 -- 172.21.15.107:0/539160850 >> v1:172.21.15.107:6789/0 conn(0x7fb8e40b4bf0 legacy=0x7fb8e406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8e99ba700 1 -- 172.21.15.107:0/539160850 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40d20f0 con 0x7fb8e415d640 2024-05-08T20:56:42.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8e99ba700 1 --2- 172.21.15.107:0/539160850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e40ce570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40d41d0 tx=0x7fb8d4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ab24cbf74fbe18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:42.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8e89b8700 1 -- 172.21.15.107:0/539160850 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4011830 con 0x7fb8e415d640 2024-05-08T20:56:42.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8e89b8700 1 -- 172.21.15.107:0/539160850 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d4011990 con 0x7fb8e415d640 2024-05-08T20:56:42.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8e89b8700 1 -- 172.21.15.107:0/539160850 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4011d20 con 0x7fb8e415d640 2024-05-08T20:56:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/539160850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 msgr2=0x7fb8e40ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/539160850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e40ce570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40d41d0 tx=0x7fb8d4009b30 comp rx=0 tx=0).stop 2024-05-08T20:56:42.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/539160850 shutdown_connections 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/539160850 >> v2:172.21.15.195:3300/0 conn(0x7fb8e40d2bd0 0x7fb8e40d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/539160850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e40ce570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/539160850 >> 172.21.15.107:0/539160850 conn(0x7fb8e4073cf0 msgr2=0x7fb8e40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/539160850 shutdown_connections 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/539160850 wait complete. 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 Processor -- start 2024-05-08T20:56:42.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.576+0000 7fb8ebc1e700 1 -- start start 2024-05-08T20:56:42.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8e40b4bf0 0x7fb8e414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8e40d2bd0 0x7fb8e41f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e414bb40 con 0x7fb8e415d640 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4155800 con 0x7fb8e40b4bf0 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e41f41e0 con 0x7fb8e40d2bd0 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40258/0 (socket says 172.21.15.107:40258) 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 -- 172.21.15.107:0/2053700456 learned_addr learned my addr 172.21.15.107:0/2053700456 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8e99ba700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8e40b4bf0 0x7fb8e414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8e91b9700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8e40d2bd0 0x7fb8e41f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 -- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8e40d2bd0 msgr2=0x7fb8e41f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8e40d2bd0 0x7fb8e41f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 -- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8e40b4bf0 msgr2=0x7fb8e414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:42.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8e40b4bf0 0x7fb8e414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 -- 172.21.15.107:0/2053700456 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40094b0 con 0x7fb8e415d640 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ea1bb700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e415dc80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00cba0 tx=0x7fb8dc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc007480 con 0x7fb8e415d640 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc0075e0 con 0x7fb8e415d640 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e4160be0 con 0x7fb8e415d640 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc007970 con 0x7fb8e415d640 2024-05-08T20:56:42.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e41551b0 con 0x7fb8e415d640 2024-05-08T20:56:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.580+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e4160e00 con 0x7fb8e415d640 2024-05-08T20:56:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.584+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8dc01b3b0 con 0x7fb8e415d640 2024-05-08T20:56:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.584+0000 7fb8da7fc700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8c8066730 0x7fb8c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.584+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8dc083ae0 con 0x7fb8e415d640 2024-05-08T20:56:42.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.584+0000 7fb8e99ba700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8c8066730 0x7fb8c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:42.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.584+0000 7fb8e99ba700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8c8066730 0x7fb8c8068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4000c00 tx=0x7fb8d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:42.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.588+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb8dc050e50 con 0x7fb8e415d640 2024-05-08T20:56:42.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:42.800+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb8e40684b0 con 0x7fb8e415d640 2024-05-08T20:56:43.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.784+0000 7fb8da7fc700 1 -- 172.21.15.107:0/2053700456 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb8dc017020 con 0x7fb8e415d640 2024-05-08T20:56:43.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8c8066730 msgr2=0x7fb8c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:43.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8c8066730 0x7fb8c8068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4000c00 tx=0x7fb8d4008030 comp rx=0 tx=0).stop 2024-05-08T20:56:43.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 msgr2=0x7fb8e415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:43.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e415dc80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00cba0 tx=0x7fb8dc00cbd0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 shutdown_connections 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e415d640 0x7fb8e415dc80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8c8066730 0x7fb8c8068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb8e40d2bd0 0x7fb8e41f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 --2- 172.21.15.107:0/2053700456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8e40b4bf0 0x7fb8e414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 >> 172.21.15.107:0/2053700456 conn(0x7fb8e4073cf0 msgr2=0x7fb8e40d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 shutdown_connections 2024-05-08T20:56:43.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.788+0000 7fb8ebc1e700 1 -- 172.21.15.107:0/2053700456 wait complete. 2024-05-08T20:56:43.813 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-08T20:56:43.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-08T20:56:43.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 Processor -- start 2024-05-08T20:56:43.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 -- start start 2024-05-08T20:56:43.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:43.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ca00d0050 0x7f6ca00b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:43.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00d3d40 con 0x7f6ca00d1da0 2024-05-08T20:56:43.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00d0d00 con 0x7f6ca00d0050 2024-05-08T20:56:43.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca51d9700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00d0fe0 con 0x7f6ca0160920 2024-05-08T20:56:43.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6ca49d8700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f6ca00d0050 0x7f6ca00b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:43.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6c9f7fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6ca00d1da0 0x7f6ca00cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55668/0 (socket says 172.21.15.107:55668) 2024-05-08T20:56:43.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6c9f7fe700 1 -- 172.21.15.107:0/958338103 learned_addr learned my addr 172.21.15.107:0/958338103 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:43.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6c9ffff700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6c9effd700 1 -- 172.21.15.107:0/958338103 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444549464 0 0) 0x7f6ca00d3d40 con 0x7f6ca00d1da0 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.928+0000 7f6c9effd700 1 -- 172.21.15.107:0/958338103 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c880035d0 con 0x7f6ca00d1da0 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca49d8700 1 -- 172.21.15.107:0/958338103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 msgr2=0x7f6ca00ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca49d8700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca00ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca49d8700 1 -- 172.21.15.107:0/958338103 >> v1:172.21.15.107:6789/0 conn(0x7f6ca00d1da0 legacy=0x7f6ca00cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9effd700 1 -- 172.21.15.107:0/958338103 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312914013 0 0) 0x7f6c880035d0 con 0x7f6ca00d1da0 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca49d8700 1 -- 172.21.15.107:0/958338103 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00d12c0 con 0x7f6ca00d0050 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9ffff700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca00ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca49d8700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca00b5e50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24105885ca068f61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9effd700 1 -- 172.21.15.107:0/958338103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800e070 con 0x7f6ca00d0050 2024-05-08T20:56:43.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9effd700 1 -- 172.21.15.107:0/958338103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98003a40 con 0x7f6ca00d0050 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9effd700 1 -- 172.21.15.107:0/958338103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90001670 con 0x7f6ca00d0050 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- 172.21.15.107:0/958338103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 msgr2=0x7f6ca00b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca00b5e50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d90 tx=0x7f6c9800b330 comp rx=0 tx=0).stop 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- 172.21.15.107:0/958338103 shutdown_connections 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca00b5e50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/958338103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca00ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- 172.21.15.107:0/958338103 >> 172.21.15.107:0/958338103 conn(0x7f6ca009c340 msgr2=0x7f6ca00d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- 172.21.15.107:0/958338103 shutdown_connections 2024-05-08T20:56:43.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- 172.21.15.107:0/958338103 wait complete. 2024-05-08T20:56:43.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 Processor -- start 2024-05-08T20:56:43.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- start start 2024-05-08T20:56:43.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca01e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:43.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca00d1da0 0x7f6ca00b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:43.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca01476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00b7560 con 0x7f6ca00d0050 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca014b0f0 con 0x7f6ca00d1da0 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca51d9700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00b6ea0 con 0x7f6ca0160920 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca01e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca01e9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40280/0 (socket says 172.21.15.107:40280) 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6c9ffff700 1 -- 172.21.15.107:0/1537930715 learned_addr learned my addr 172.21.15.107:0/1537930715 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.932+0000 7f6ca49d8700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca01476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9f7fe700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca00d1da0 0x7f6ca00b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9ffff700 1 -- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 msgr2=0x7f6ca01476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9ffff700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca01476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9ffff700 1 -- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca00d1da0 msgr2=0x7f6ca00b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9ffff700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca00d1da0 0x7f6ca00b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:43.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9ffff700 1 -- 172.21.15.107:0/1537930715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c940094b0 con 0x7f6ca00d0050 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9f7fe700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca00d1da0 0x7f6ca00b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9ffff700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca01e9100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400ebe0 tx=0x7f6c9400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400c890 con 0x7f6ca00d0050 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9400c9f0 con 0x7f6ca00d0050 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98009a70 con 0x7f6ca00d0050 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400cd80 con 0x7f6ca00d0050 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca0160e80 con 0x7f6ca00d0050 2024-05-08T20:56:43.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.936+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca00d25a0 con 0x7f6ca00d0050 2024-05-08T20:56:43.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.940+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c94013470 con 0x7f6ca00d0050 2024-05-08T20:56:43.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.940+0000 7f6c9cff9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6c8c066730 0x7f6c8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:43.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.940+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c94084260 con 0x7f6ca00d0050 2024-05-08T20:56:43.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.940+0000 7f6c9f7fe700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6c8c066730 0x7f6c8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:43.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.940+0000 7f6c9f7fe700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6c8c066730 0x7f6c8c068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c90007fd0 tx=0x7f6c90007b20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:43.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:43.948+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6c94051660 con 0x7f6ca00d0050 2024-05-08T20:56:44.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.152+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6ca00684b0 con 0x7f6ca00d0050 2024-05-08T20:56:44.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.784+0000 7f6c9cff9700 1 -- 172.21.15.107:0/1537930715 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c94054c80 con 0x7f6ca00d0050 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6c8c066730 msgr2=0x7f6c8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6c8c066730 0x7f6c8c068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c90007fd0 tx=0x7f6c90007b20 comp rx=0 tx=0).stop 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 msgr2=0x7f6ca01e9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca01e9100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400ebe0 tx=0x7f6c9400eef0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 shutdown_connections 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6c8c066730 0x7f6c8c068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6ca0160920 0x7f6ca01476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6ca00d1da0 0x7f6ca00b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 --2- 172.21.15.107:0/1537930715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6ca00d0050 0x7f6ca01e9100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 >> 172.21.15.107:0/1537930715 conn(0x7f6ca009c340 msgr2=0x7f6ca006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:44.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 shutdown_connections 2024-05-08T20:56:44.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.792+0000 7f6ca51d9700 1 -- 172.21.15.107:0/1537930715 wait complete. 2024-05-08T20:56:44.817 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-08T20:56:44.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fea46700 1 Processor -- start 2024-05-08T20:56:44.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fea46700 1 -- start start 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fea46700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61f80ce510 0x7f61f815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fea46700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80ce080 con 0x7f61f8071ab0 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fea46700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f80cd7c0 con 0x7f61f815aaa0 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fea46700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80cda30 con 0x7f61f80ce510 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fd243700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61f80ce510 0x7f61f815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fd243700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f61f80ce510 0x7f61f815a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40294/0 (socket says 172.21.15.107:40294) 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.932+0000 7f61fd243700 1 -- 172.21.15.107:0/4002379354 learned_addr learned my addr 172.21.15.107:0/4002379354 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fd243700 1 -- 172.21.15.107:0/4002379354 >> v1:172.21.15.195:6789/0 conn(0x7f61f815aaa0 legacy=0x7f61f813d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fd243700 1 -- 172.21.15.107:0/4002379354 >> v1:172.21.15.107:6789/0 conn(0x7f61f8071ab0 legacy=0x7f61f8071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:44.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fd243700 1 -- 172.21.15.107:0/4002379354 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80cdd10 con 0x7f61f80ce510 2024-05-08T20:56:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fd243700 1 --2- 172.21.15.107:0/4002379354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f815a560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009910 tx=0x7f61e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb76ca3879fc2c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fca42700 1 -- 172.21.15.107:0/4002379354 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8004230 con 0x7f61f80ce510 2024-05-08T20:56:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fca42700 1 -- 172.21.15.107:0/4002379354 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8004390 con 0x7f61f80ce510 2024-05-08T20:56:44.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fca42700 1 -- 172.21.15.107:0/4002379354 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8009e60 con 0x7f61f80ce510 2024-05-08T20:56:44.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 -- 172.21.15.107:0/4002379354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 msgr2=0x7f61f815a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:44.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 --2- 172.21.15.107:0/4002379354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f815a560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009910 tx=0x7f61e8009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:44.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 -- 172.21.15.107:0/4002379354 shutdown_connections 2024-05-08T20:56:44.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 --2- 172.21.15.107:0/4002379354 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f815a560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 -- 172.21.15.107:0/4002379354 >> 172.21.15.107:0/4002379354 conn(0x7f61f806c330 msgr2=0x7f61f806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 -- 172.21.15.107:0/4002379354 shutdown_connections 2024-05-08T20:56:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 -- 172.21.15.107:0/4002379354 wait complete. 2024-05-08T20:56:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 Processor -- start 2024-05-08T20:56:44.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.936+0000 7f61fea46700 1 -- start start 2024-05-08T20:56:44.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f8071ab0 0x7f61f80b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:44.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f81344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f815aaa0 0x7f61f8140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81684a0 con 0x7f61f80ce510 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8130bc0 con 0x7f61f815aaa0 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81686f0 con 0x7f61f8071ab0 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f81344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fda44700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f8071ab0 0x7f61f80b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f81344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40302/0 (socket says 172.21.15.107:40302) 2024-05-08T20:56:44.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 -- 172.21.15.107:0/1667975931 learned_addr learned my addr 172.21.15.107:0/1667975931 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fe245700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f815aaa0 0x7f61f8140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 -- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f8071ab0 msgr2=0x7f61f80b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f8071ab0 0x7f61f80b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 -- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f815aaa0 msgr2=0x7f61f8140660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f815aaa0 0x7f61f8140660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 -- 172.21.15.107:0/1667975931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8009570 con 0x7f61f80ce510 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fda44700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f8071ab0 0x7f61f80b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fd243700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f81344b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61e8008000 tx=0x7f61e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800bc50 con 0x7f61f80ce510 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e801f070 con 0x7f61f80ce510 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80036c0 con 0x7f61f80ce510 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f81689d0 con 0x7f61f80ce510 2024-05-08T20:56:44.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f8168f90 con 0x7f61f80ce510 2024-05-08T20:56:44.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.940+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80684b0 con 0x7f61f80ce510 2024-05-08T20:56:44.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.944+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61e8021030 con 0x7f61f80ce510 2024-05-08T20:56:44.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.944+0000 7f61ee7fc700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066760 0x7f61dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:44.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.944+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61e8085850 con 0x7f61f80ce510 2024-05-08T20:56:44.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.944+0000 7f61fda44700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066760 0x7f61dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:44.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.944+0000 7f61fda44700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066760 0x7f61dc068c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61f4001c90 tx=0x7f61f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:44.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:44.952+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f61e8052c50 con 0x7f61f80ce510 2024-05-08T20:56:45.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.156+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61f80684b0 con 0x7f61f80ce510 2024-05-08T20:56:45.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61ee7fc700 1 -- 172.21.15.107:0/1667975931 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f61e8056270 con 0x7f61f80ce510 2024-05-08T20:56:45.167 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:45.167 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:56:41.769074+0000","modified":"2024-05-08T20:56:44.783973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:56:45.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066760 msgr2=0x7f61dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066760 0x7f61dc068c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61f4001c90 tx=0x7f61f4009040 comp rx=0 tx=0).stop 2024-05-08T20:56:45.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 msgr2=0x7f61f81344b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f81344b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f61e8008000 tx=0x7f61e8004770 comp rx=0 tx=0).stop 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 shutdown_connections 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f815aaa0 0x7f61f8140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f80ce510 0x7f61f81344b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066760 0x7f61dc068c20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 --2- 172.21.15.107:0/1667975931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f8071ab0 0x7f61f80b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 >> 172.21.15.107:0/1667975931 conn(0x7f61f806c330 msgr2=0x7f61f813e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 shutdown_connections 2024-05-08T20:56:45.170 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.160+0000 7f61fea46700 1 -- 172.21.15.107:0/1667975931 wait complete. 2024-05-08T20:56:45.171 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-05-08T20:56:45.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.288+0000 7ffb84d90700 1 Processor -- start 2024-05-08T20:56:45.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.288+0000 7ffb84d90700 1 -- start start 2024-05-08T20:56:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffb8006ca60 0x7ffb800cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800cd470 con 0x7ffb8015aed0 2024-05-08T20:56:45.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800ced50 con 0x7ffb800cb970 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800cceb0 con 0x7ffb8006ca60 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7e59c700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ffb8015aed0 0x7ffb800b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55690/0 (socket says 172.21.15.107:55690) 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7e59c700 1 -- 172.21.15.107:0/403108439 learned_addr learned my addr 172.21.15.107:0/403108439 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7ed9d700 1 --2- 172.21.15.107:0/403108439 >> v2:172.21.15.107:3300/0 conn(0x7ffb8006ca60 0x7ffb800cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7d59a700 1 -- 172.21.15.107:0/403108439 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587803149 0 0) 0x7ffb800cd470 con 0x7ffb8015aed0 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7ed9d700 1 -- 172.21.15.107:0/403108439 >> v1:172.21.15.195:6789/0 conn(0x7ffb800cb970 legacy=0x7ffb8006c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7ed9d700 1 -- 172.21.15.107:0/403108439 >> v1:172.21.15.107:6789/0 conn(0x7ffb8015aed0 legacy=0x7ffb800b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7ed9d700 1 -- 172.21.15.107:0/403108439 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800cd190 con 0x7ffb8006ca60 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7ed9d700 1 --2- 172.21.15.107:0/403108439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb8006ca60 0x7ffb800cc7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009850 tx=0x7ffb70009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a8330f32c11285 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7d59a700 1 -- 172.21.15.107:0/403108439 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70011830 con 0x7ffb8006ca60 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7d59a700 1 -- 172.21.15.107:0/403108439 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70011990 con 0x7ffb8006ca60 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb7d59a700 1 -- 172.21.15.107:0/403108439 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70011d20 con 0x7ffb8006ca60 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- 172.21.15.107:0/403108439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb8006ca60 msgr2=0x7ffb800cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 --2- 172.21.15.107:0/403108439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb8006ca60 0x7ffb800cc7c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffb70009850 tx=0x7ffb70009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:45.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- 172.21.15.107:0/403108439 shutdown_connections 2024-05-08T20:56:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 --2- 172.21.15.107:0/403108439 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb8006ca60 0x7ffb800cc7c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- 172.21.15.107:0/403108439 >> 172.21.15.107:0/403108439 conn(0x7ffb8006a360 msgr2=0x7ffb8006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- 172.21.15.107:0/403108439 shutdown_connections 2024-05-08T20:56:45.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.292+0000 7ffb84d90700 1 -- 172.21.15.107:0/403108439 wait complete. 2024-05-08T20:56:45.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 Processor -- start 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 -- start start 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8006ca60 0x7ffb801468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 0x7ffb800addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8015aed0 0x7ffb801f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80146e30 con 0x7ffb800cb970 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800acd50 con 0x7ffb8015aed0 2024-05-08T20:56:45.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb84d90700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800ad030 con 0x7ffb8006ca60 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 0x7ffb800addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb7ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8015aed0 0x7ffb801f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb7dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 0x7ffb800addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40314/0 (socket says 172.21.15.107:40314) 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb7dd9b700 1 -- 172.21.15.107:0/326643629 learned_addr learned my addr 172.21.15.107:0/326643629 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.296+0000 7ffb7e59c700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8006ca60 0x7ffb801468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb7dd9b700 1 -- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8006ca60 msgr2=0x7ffb801468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb7dd9b700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8006ca60 0x7ffb801468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb7dd9b700 1 -- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8015aed0 msgr2=0x7ffb801f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb7dd9b700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8015aed0 0x7ffb801f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb7dd9b700 1 -- 172.21.15.107:0/326643629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700094b0 con 0x7ffb800cb970 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb7dd9b700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 0x7ffb800addf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c500 tx=0x7ffb7400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740052d0 con 0x7ffb800cb970 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74005430 con 0x7ffb800cb970 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb800ad310 con 0x7ffb800cb970 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740055a0 con 0x7ffb800cb970 2024-05-08T20:56:45.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.300+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb800ad8d0 con 0x7ffb800cb970 2024-05-08T20:56:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.304+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb740038e0 con 0x7ffb800cb970 2024-05-08T20:56:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.304+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb800684b0 con 0x7ffb800cb970 2024-05-08T20:56:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.304+0000 7ffb6effd700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb60066730 0x7ffb60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.304+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb740835a0 con 0x7ffb800cb970 2024-05-08T20:56:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.304+0000 7ffb7e59c700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb60066730 0x7ffb60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.304+0000 7ffb7e59c700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb60066730 0x7ffb60068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb78001cf0 tx=0x7ffb78001c80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.312+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ffb74050870 con 0x7ffb800cb970 2024-05-08T20:56:45.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.488+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb800b1e30 con 0x7ffb800cb970 2024-05-08T20:56:45.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.488+0000 7ffb6effd700 1 -- 172.21.15.107:0/326643629 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ffb800b1e30 con 0x7ffb800cb970 2024-05-08T20:56:45.497 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:45.497 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:42.773336+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:45.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb60066730 msgr2=0x7ffb60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb60066730 0x7ffb60068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb78001cf0 tx=0x7ffb78001c80 comp rx=0 tx=0).stop 2024-05-08T20:56:45.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 msgr2=0x7ffb800addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 0x7ffb800addf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400c500 tx=0x7ffb7400c810 comp rx=0 tx=0).stop 2024-05-08T20:56:45.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 shutdown_connections 2024-05-08T20:56:45.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8015aed0 0x7ffb801f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb800cb970 0x7ffb800addf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb60066730 0x7ffb60068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 --2- 172.21.15.107:0/326643629 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8006ca60 0x7ffb801468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 >> 172.21.15.107:0/326643629 conn(0x7ffb8006a360 msgr2=0x7ffb80157310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:45.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 shutdown_connections 2024-05-08T20:56:45.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.492+0000 7ffb84d90700 1 -- 172.21.15.107:0/326643629 wait complete. 2024-05-08T20:56:45.511 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T20:56:45.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:56:45.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 Processor -- start 2024-05-08T20:56:45.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- start start 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64400ce510 0x7f644015a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f644015aaa0 0x7f644013d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64400ce080 con 0x7f6440071ab0 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400cd7c0 con 0x7f64400ce510 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400cda30 con 0x7f644015aaa0 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64400ce510 0x7f644015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f64400ce510 0x7f644015a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40320/0 (socket says 172.21.15.107:40320) 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 -- 172.21.15.107:0/3433124471 learned_addr learned my addr 172.21.15.107:0/3433124471 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:45.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643ffff700 1 --2- 172.21.15.107:0/3433124471 >> v2:172.21.15.195:3300/0 conn(0x7f644015aaa0 0x7f644013d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 -- 172.21.15.107:0/3433124471 >> v2:172.21.15.195:3300/0 conn(0x7f644015aaa0 msgr2=0x7f644013d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 --2- 172.21.15.107:0/3433124471 >> v2:172.21.15.195:3300/0 conn(0x7f644015aaa0 0x7f644013d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 -- 172.21.15.107:0/3433124471 >> v1:172.21.15.195:6789/0 conn(0x7f6440071ab0 legacy=0x7f6440071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 -- 172.21.15.107:0/3433124471 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400cdd10 con 0x7f64400ce510 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643effd700 1 --2- 172.21.15.107:0/3433124471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f644015a560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6440074590 tx=0x7f642800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febbab13aacdc25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643e7fc700 1 -- 172.21.15.107:0/3433124471 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800dd50 con 0x7f64400ce510 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643e7fc700 1 -- 172.21.15.107:0/3433124471 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428004030 con 0x7f64400ce510 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f643e7fc700 1 -- 172.21.15.107:0/3433124471 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64280043c0 con 0x7f64400ce510 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- 172.21.15.107:0/3433124471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 msgr2=0x7f644015a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 --2- 172.21.15.107:0/3433124471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f644015a560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6440074590 tx=0x7f642800be90 comp rx=0 tx=0).stop 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- 172.21.15.107:0/3433124471 shutdown_connections 2024-05-08T20:56:45.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 --2- 172.21.15.107:0/3433124471 >> v2:172.21.15.195:3300/0 conn(0x7f644015aaa0 0x7f644013d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 --2- 172.21.15.107:0/3433124471 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f644015a560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- 172.21.15.107:0/3433124471 >> 172.21.15.107:0/3433124471 conn(0x7f644006c330 msgr2=0x7f644006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- 172.21.15.107:0/3433124471 shutdown_connections 2024-05-08T20:56:45.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.616+0000 7f6444aef700 1 -- 172.21.15.107:0/3433124471 wait complete. 2024-05-08T20:56:45.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 Processor -- start 2024-05-08T20:56:45.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 -- start start 2024-05-08T20:56:45.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6440071ab0 0x7f64401eefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f64401372d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f644015aaa0 0x7f64401592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440140700 con 0x7f64400ce510 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64401409e0 con 0x7f644015aaa0 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6440140cc0 con 0x7f6440071ab0 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f64401372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f64401372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40326/0 (socket says 172.21.15.107:40326) 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 -- 172.21.15.107:0/3723628118 learned_addr learned my addr 172.21.15.107:0/3723628118 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643ffff700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f644015aaa0 0x7f64401592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643f7fe700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6440071ab0 0x7f64401eefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 -- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6440071ab0 msgr2=0x7f64401eefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6440071ab0 0x7f64401eefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 -- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f644015aaa0 msgr2=0x7f64401592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f644015aaa0 0x7f64401592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 -- 172.21.15.107:0/3723628118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642800b810 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643ffff700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f644015aaa0 0x7f64401592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f643effd700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f64401372d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f644006b120 tx=0x7f6428004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428020070 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428003bc0 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6440140fa0 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428010470 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.620+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64401ef4f0 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.624+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64401414c0 con 0x7f64400ce510 2024-05-08T20:56:45.633 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.624+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64280193f0 con 0x7f64400ce510 2024-05-08T20:56:45.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.624+0000 7f6437fff700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6420066730 0x7f6420068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.624+0000 7f643f7fe700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6420066730 0x7f6420068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.624+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64280877d0 con 0x7f64400ce510 2024-05-08T20:56:45.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.624+0000 7f643f7fe700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6420066730 0x7f6420068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6430009890 tx=0x7f6430008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.632+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f64401414c0 con 0x7f64400ce510 2024-05-08T20:56:45.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.796+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f644013b450 con 0x7f6420066730 2024-05-08T20:56:45.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.804+0000 7f6437fff700 1 -- 172.21.15.107:0/3723628118 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264609 (secure 0 0 0) 0x7f644013b450 con 0x7f6420066730 2024-05-08T20:56:45.817 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6420066730 msgr2=0x7f6420068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6420066730 0x7f6420068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6430009890 tx=0x7f6430008040 comp rx=0 tx=0).stop 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 msgr2=0x7f64401372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f64401372d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f644006b120 tx=0x7f6428004770 comp rx=0 tx=0).stop 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 shutdown_connections 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f644015aaa0 0x7f64401592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f64400ce510 0x7f64401372d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6420066730 0x7f6420068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 --2- 172.21.15.107:0/3723628118 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6440071ab0 0x7f64401eefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 >> 172.21.15.107:0/3723628118 conn(0x7f644006c330 msgr2=0x7f644013ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 shutdown_connections 2024-05-08T20:56:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.808+0000 7f6444aef700 1 -- 172.21.15.107:0/3723628118 wait complete. 2024-05-08T20:56:45.821 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T20:56:45.829 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T20:56:44.697366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235356,"kb_used_data":2772,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739364,"statfs":{"total":773094113280,"available":772853108736,"internally_reserved":0,"allocated":2838528,"data_stored":1726425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":238014010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.311801"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273716+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T20:56:43.273716+0000","last_peered":"2024-05-08T20:56:43.273716+0000","last_clean":"2024-05-08T20:56:43.273716+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T20:56:43.273716+0000","last_undegraded":"2024-05-08T20:56:43.273716+0000","last_fullsized":"2024-05-08T20:56:43.273716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786417+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T20:56:42.786417+0000","last_peered":"2024-05-08T20:56:42.786417+0000","last_clean":"2024-05-08T20:56:42.786417+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T20:56:42.786417+0000","last_undegraded":"2024-05-08T20:56:42.786417+0000","last_fullsized":"2024-05-08T20:56:42.786417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273684+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T20:56:43.273684+0000","last_peered":"2024-05-08T20:56:43.273684+0000","last_clean":"2024-05-08T20:56:43.273684+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T20:56:43.273684+0000","last_undegraded":"2024-05-08T20:56:43.273684+0000","last_fullsized":"2024-05-08T20:56:43.273684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786779+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T20:56:42.786779+0000","last_peered":"2024-05-08T20:56:42.786779+0000","last_clean":"2024-05-08T20:56:42.786779+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T20:56:42.786779+0000","last_undegraded":"2024-05-08T20:56:42.786779+0000","last_fullsized":"2024-05-08T20:56:42.786779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273146+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T20:56:43.273146+0000","last_peered":"2024-05-08T20:56:43.273146+0000","last_clean":"2024-05-08T20:56:43.273146+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T20:56:43.273146+0000","last_undegraded":"2024-05-08T20:56:43.273146+0000","last_fullsized":"2024-05-08T20:56:43.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786495+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T20:56:42.786495+0000","last_peered":"2024-05-08T20:56:42.786495+0000","last_clean":"2024-05-08T20:56:42.786495+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T20:56:42.786495+0000","last_undegraded":"2024-05-08T20:56:42.786495+0000","last_fullsized":"2024-05-08T20:56:42.786495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272601+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T20:56:43.272601+0000","last_peered":"2024-05-08T20:56:43.272601+0000","last_clean":"2024-05-08T20:56:43.272601+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T20:56:43.272601+0000","last_undegraded":"2024-05-08T20:56:43.272601+0000","last_fullsized":"2024-05-08T20:56:43.272601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273717+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T20:56:43.273717+0000","last_peered":"2024-05-08T20:56:43.273717+0000","last_clean":"2024-05-08T20:56:43.273717+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T20:56:43.273717+0000","last_undegraded":"2024-05-08T20:56:43.273717+0000","last_fullsized":"2024-05-08T20:56:43.273717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043718+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T20:56:43.043718+0000","last_peered":"2024-05-08T20:56:43.043718+0000","last_clean":"2024-05-08T20:56:43.043718+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T20:56:43.043718+0000","last_undegraded":"2024-05-08T20:56:43.043718+0000","last_fullsized":"2024-05-08T20:56:43.043718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043303+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T20:56:43.043303+0000","last_peered":"2024-05-08T20:56:43.043303+0000","last_clean":"2024-05-08T20:56:43.043303+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T20:56:43.043303+0000","last_undegraded":"2024-05-08T20:56:43.043303+0000","last_fullsized":"2024-05-08T20:56:43.043303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788169+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T20:56:42.788169+0000","last_peered":"2024-05-08T20:56:42.788169+0000","last_clean":"2024-05-08T20:56:42.788169+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T20:56:42.788169+0000","last_undegraded":"2024-05-08T20:56:42.788169+0000","last_fullsized":"2024-05-08T20:56:42.788169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274034+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T20:56:43.274034+0000","last_peered":"2024-05-08T20:56:43.274034+0000","last_clean":"2024-05-08T20:56:43.274034+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T20:56:43.274034+0000","last_undegraded":"2024-05-08T20:56:43.274034+0000","last_fullsized":"2024-05-08T20:56:43.274034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273554+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T20:56:43.273554+0000","last_peered":"2024-05-08T20:56:43.273554+0000","last_clean":"2024-05-08T20:56:43.273554+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T20:56:43.273554+0000","last_undegraded":"2024-05-08T20:56:43.273554+0000","last_fullsized":"2024-05-08T20:56:43.273554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785960+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T20:56:42.785960+0000","last_peered":"2024-05-08T20:56:42.785960+0000","last_clean":"2024-05-08T20:56:42.785960+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T20:56:42.785960+0000","last_undegraded":"2024-05-08T20:56:42.785960+0000","last_fullsized":"2024-05-08T20:56:42.785960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786454+0000","last_change":"2024-05-08T20:56:41.791132+0000","last_active":"2024-05-08T20:56:42.786454+0000","last_peered":"2024-05-08T20:56:42.786454+0000","last_clean":"2024-05-08T20:56:42.786454+0000","last_became_active":"2024-05-08T20:56:41.790838+0000","last_became_peered":"2024-05-08T20:56:41.790838+0000","last_unstale":"2024-05-08T20:56:42.786454+0000","last_undegraded":"2024-05-08T20:56:42.786454+0000","last_fullsized":"2024-05-08T20:56:42.786454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787321+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T20:56:42.787321+0000","last_peered":"2024-05-08T20:56:42.787321+0000","last_clean":"2024-05-08T20:56:42.787321+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T20:56:42.787321+0000","last_undegraded":"2024-05-08T20:56:42.787321+0000","last_fullsized":"2024-05-08T20:56:42.787321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793458+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T20:56:42.793458+0000","last_peered":"2024-05-08T20:56:42.793458+0000","last_clean":"2024-05-08T20:56:42.793458+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T20:56:42.793458+0000","last_undegraded":"2024-05-08T20:56:42.793458+0000","last_fullsized":"2024-05-08T20:56:42.793458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273673+0000","last_change":"2024-05-08T20:56:41.802323+0000","last_active":"2024-05-08T20:56:43.273673+0000","last_peered":"2024-05-08T20:56:43.273673+0000","last_clean":"2024-05-08T20:56:43.273673+0000","last_became_active":"2024-05-08T20:56:41.798890+0000","last_became_peered":"2024-05-08T20:56:41.798890+0000","last_unstale":"2024-05-08T20:56:43.273673+0000","last_undegraded":"2024-05-08T20:56:43.273673+0000","last_fullsized":"2024-05-08T20:56:43.273673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043301+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.043301+0000","last_peered":"2024-05-08T20:56:43.043301+0000","last_clean":"2024-05-08T20:56:43.043301+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.043301+0000","last_undegraded":"2024-05-08T20:56:43.043301+0000","last_fullsized":"2024-05-08T20:56:43.043301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273478+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T20:56:43.273478+0000","last_peered":"2024-05-08T20:56:43.273478+0000","last_clean":"2024-05-08T20:56:43.273478+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T20:56:43.273478+0000","last_undegraded":"2024-05-08T20:56:43.273478+0000","last_fullsized":"2024-05-08T20:56:43.273478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786653+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T20:56:42.786653+0000","last_peered":"2024-05-08T20:56:42.786653+0000","last_clean":"2024-05-08T20:56:42.786653+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T20:56:42.786653+0000","last_undegraded":"2024-05-08T20:56:42.786653+0000","last_fullsized":"2024-05-08T20:56:42.786653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272750+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T20:56:43.272750+0000","last_peered":"2024-05-08T20:56:43.272750+0000","last_clean":"2024-05-08T20:56:43.272750+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T20:56:43.272750+0000","last_undegraded":"2024-05-08T20:56:43.272750+0000","last_fullsized":"2024-05-08T20:56:43.272750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786490+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T20:56:42.786490+0000","last_peered":"2024-05-08T20:56:42.786490+0000","last_clean":"2024-05-08T20:56:42.786490+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T20:56:42.786490+0000","last_undegraded":"2024-05-08T20:56:42.786490+0000","last_fullsized":"2024-05-08T20:56:42.786490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274272+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T20:56:43.274272+0000","last_peered":"2024-05-08T20:56:43.274272+0000","last_clean":"2024-05-08T20:56:43.274272+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T20:56:43.274272+0000","last_undegraded":"2024-05-08T20:56:43.274272+0000","last_fullsized":"2024-05-08T20:56:43.274272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043789+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T20:56:43.043789+0000","last_peered":"2024-05-08T20:56:43.043789+0000","last_clean":"2024-05-08T20:56:43.043789+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T20:56:43.043789+0000","last_undegraded":"2024-05-08T20:56:43.043789+0000","last_fullsized":"2024-05-08T20:56:43.043789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786283+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T20:56:42.786283+0000","last_peered":"2024-05-08T20:56:42.786283+0000","last_clean":"2024-05-08T20:56:42.786283+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T20:56:42.786283+0000","last_undegraded":"2024-05-08T20:56:42.786283+0000","last_fullsized":"2024-05-08T20:56:42.786283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274673+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.274673+0000","last_peered":"2024-05-08T20:56:43.274673+0000","last_clean":"2024-05-08T20:56:43.274673+0000","last_became_active":"2024-05-08T20:56:41.810632+0000","last_became_peered":"2024-05-08T20:56:41.810632+0000","last_unstale":"2024-05-08T20:56:43.274673+0000","last_undegraded":"2024-05-08T20:56:43.274673+0000","last_fullsized":"2024-05-08T20:56:43.274673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273719+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T20:56:43.273719+0000","last_peered":"2024-05-08T20:56:43.273719+0000","last_clean":"2024-05-08T20:56:43.273719+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T20:56:43.273719+0000","last_undegraded":"2024-05-08T20:56:43.273719+0000","last_fullsized":"2024-05-08T20:56:43.273719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787815+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T20:56:42.787815+0000","last_peered":"2024-05-08T20:56:42.787815+0000","last_clean":"2024-05-08T20:56:42.787815+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T20:56:42.787815+0000","last_undegraded":"2024-05-08T20:56:42.787815+0000","last_fullsized":"2024-05-08T20:56:42.787815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793490+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T20:56:42.793490+0000","last_peered":"2024-05-08T20:56:42.793490+0000","last_clean":"2024-05-08T20:56:42.793490+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T20:56:42.793490+0000","last_undegraded":"2024-05-08T20:56:42.793490+0000","last_fullsized":"2024-05-08T20:56:42.793490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042896+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T20:56:43.042896+0000","last_peered":"2024-05-08T20:56:43.042896+0000","last_clean":"2024-05-08T20:56:43.042896+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T20:56:43.042896+0000","last_undegraded":"2024-05-08T20:56:43.042896+0000","last_fullsized":"2024-05-08T20:56:43.042896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787032+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T20:56:42.787032+0000","last_peered":"2024-05-08T20:56:42.787032+0000","last_clean":"2024-05-08T20:56:42.787032+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T20:56:42.787032+0000","last_undegraded":"2024-05-08T20:56:42.787032+0000","last_fullsized":"2024-05-08T20:56:42.787032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274508+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:56:43.274508+0000","last_peered":"2024-05-08T20:56:43.274508+0000","last_clean":"2024-05-08T20:56:43.274508+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:56:43.274508+0000","last_undegraded":"2024-05-08T20:56:43.274508+0000","last_fullsized":"2024-05-08T20:56:43.274508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043109+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:56:43.043109+0000","last_peered":"2024-05-08T20:56:43.043109+0000","last_clean":"2024-05-08T20:56:43.043109+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:56:43.043109+0000","last_undegraded":"2024-05-08T20:56:43.043109+0000","last_fullsized":"2024-05-08T20:56:43.043109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273264+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:56:43.273264+0000","last_peered":"2024-05-08T20:56:43.273264+0000","last_clean":"2024-05-08T20:56:43.273264+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:56:43.273264+0000","last_undegraded":"2024-05-08T20:56:43.273264+0000","last_fullsized":"2024-05-08T20:56:43.273264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272849+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T20:56:43.272849+0000","last_peered":"2024-05-08T20:56:43.272849+0000","last_clean":"2024-05-08T20:56:43.272849+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T20:56:43.272849+0000","last_undegraded":"2024-05-08T20:56:43.272849+0000","last_fullsized":"2024-05-08T20:56:43.272849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:56:42.786560+0000","last_peered":"2024-05-08T20:56:42.786560+0000","last_clean":"2024-05-08T20:56:42.786560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:56:42.786560+0000","last_undegraded":"2024-05-08T20:56:42.786560+0000","last_fullsized":"2024-05-08T20:56:42.786560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785898+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T20:56:42.785898+0000","last_peered":"2024-05-08T20:56:42.785898+0000","last_clean":"2024-05-08T20:56:42.785898+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T20:56:42.785898+0000","last_undegraded":"2024-05-08T20:56:42.785898+0000","last_fullsized":"2024-05-08T20:56:42.785898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043678+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:56:43.043678+0000","last_peered":"2024-05-08T20:56:43.043678+0000","last_clean":"2024-05-08T20:56:43.043678+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:56:43.043678+0000","last_undegraded":"2024-05-08T20:56:43.043678+0000","last_fullsized":"2024-05-08T20:56:43.043678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787265+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T20:56:42.787265+0000","last_peered":"2024-05-08T20:56:42.787265+0000","last_clean":"2024-05-08T20:56:42.787265+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T20:56:42.787265+0000","last_undegraded":"2024-05-08T20:56:42.787265+0000","last_fullsized":"2024-05-08T20:56:42.787265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787227+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:56:42.787227+0000","last_peered":"2024-05-08T20:56:42.787227+0000","last_clean":"2024-05-08T20:56:42.787227+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:56:42.787227+0000","last_undegraded":"2024-05-08T20:56:42.787227+0000","last_fullsized":"2024-05-08T20:56:42.787227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273777+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T20:56:43.273777+0000","last_peered":"2024-05-08T20:56:43.273777+0000","last_clean":"2024-05-08T20:56:43.273777+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T20:56:43.273777+0000","last_undegraded":"2024-05-08T20:56:43.273777+0000","last_fullsized":"2024-05-08T20:56:43.273777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786449+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T20:56:42.786449+0000","last_peered":"2024-05-08T20:56:42.786449+0000","last_clean":"2024-05-08T20:56:42.786449+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T20:56:42.786449+0000","last_undegraded":"2024-05-08T20:56:42.786449+0000","last_fullsized":"2024-05-08T20:56:42.786449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788239+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T20:56:42.788239+0000","last_peered":"2024-05-08T20:56:42.788239+0000","last_clean":"2024-05-08T20:56:42.788239+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T20:56:42.788239+0000","last_undegraded":"2024-05-08T20:56:42.788239+0000","last_fullsized":"2024-05-08T20:56:42.788239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043359+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:56:43.043359+0000","last_peered":"2024-05-08T20:56:43.043359+0000","last_clean":"2024-05-08T20:56:43.043359+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:56:43.043359+0000","last_undegraded":"2024-05-08T20:56:43.043359+0000","last_fullsized":"2024-05-08T20:56:43.043359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273305+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T20:56:43.273305+0000","last_peered":"2024-05-08T20:56:43.273305+0000","last_clean":"2024-05-08T20:56:43.273305+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T20:56:43.273305+0000","last_undegraded":"2024-05-08T20:56:43.273305+0000","last_fullsized":"2024-05-08T20:56:43.273305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273945+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:56:43.273945+0000","last_peered":"2024-05-08T20:56:43.273945+0000","last_clean":"2024-05-08T20:56:43.273945+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:56:43.273945+0000","last_undegraded":"2024-05-08T20:56:43.273945+0000","last_fullsized":"2024-05-08T20:56:43.273945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273114+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T20:56:43.273114+0000","last_peered":"2024-05-08T20:56:43.273114+0000","last_clean":"2024-05-08T20:56:43.273114+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T20:56:43.273114+0000","last_undegraded":"2024-05-08T20:56:43.273114+0000","last_fullsized":"2024-05-08T20:56:43.273114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786739+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:56:42.786739+0000","last_peered":"2024-05-08T20:56:42.786739+0000","last_clean":"2024-05-08T20:56:42.786739+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:56:42.786739+0000","last_undegraded":"2024-05-08T20:56:42.786739+0000","last_fullsized":"2024-05-08T20:56:42.786739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273150+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T20:56:43.273150+0000","last_peered":"2024-05-08T20:56:43.273150+0000","last_clean":"2024-05-08T20:56:43.273150+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T20:56:43.273150+0000","last_undegraded":"2024-05-08T20:56:43.273150+0000","last_fullsized":"2024-05-08T20:56:43.273150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042994+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:56:43.042994+0000","last_peered":"2024-05-08T20:56:43.042994+0000","last_clean":"2024-05-08T20:56:43.042994+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:56:43.042994+0000","last_undegraded":"2024-05-08T20:56:43.042994+0000","last_fullsized":"2024-05-08T20:56:43.042994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042960+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T20:56:43.042960+0000","last_peered":"2024-05-08T20:56:43.042960+0000","last_clean":"2024-05-08T20:56:43.042960+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T20:56:43.042960+0000","last_undegraded":"2024-05-08T20:56:43.042960+0000","last_fullsized":"2024-05-08T20:56:43.042960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793237+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:56:42.793237+0000","last_peered":"2024-05-08T20:56:42.793237+0000","last_clean":"2024-05-08T20:56:42.793237+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:56:42.793237+0000","last_undegraded":"2024-05-08T20:56:42.793237+0000","last_fullsized":"2024-05-08T20:56:42.793237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787710+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:56:42.787710+0000","last_peered":"2024-05-08T20:56:42.787710+0000","last_clean":"2024-05-08T20:56:42.787710+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:56:42.787710+0000","last_undegraded":"2024-05-08T20:56:42.787710+0000","last_fullsized":"2024-05-08T20:56:42.787710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273687+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T20:56:43.273687+0000","last_peered":"2024-05-08T20:56:43.273687+0000","last_clean":"2024-05-08T20:56:43.273687+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T20:56:43.273687+0000","last_undegraded":"2024-05-08T20:56:43.273687+0000","last_fullsized":"2024-05-08T20:56:43.273687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793472+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:56:42.793472+0000","last_peered":"2024-05-08T20:56:42.793472+0000","last_clean":"2024-05-08T20:56:42.793472+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:56:42.793472+0000","last_undegraded":"2024-05-08T20:56:42.793472+0000","last_fullsized":"2024-05-08T20:56:42.793472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273910+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T20:56:43.273910+0000","last_peered":"2024-05-08T20:56:43.273910+0000","last_clean":"2024-05-08T20:56:43.273910+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T20:56:43.273910+0000","last_undegraded":"2024-05-08T20:56:43.273910+0000","last_fullsized":"2024-05-08T20:56:43.273910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786606+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:56:42.786606+0000","last_peered":"2024-05-08T20:56:42.786606+0000","last_clean":"2024-05-08T20:56:42.786606+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:56:42.786606+0000","last_undegraded":"2024-05-08T20:56:42.786606+0000","last_fullsized":"2024-05-08T20:56:42.786606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786994+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T20:56:42.786994+0000","last_peered":"2024-05-08T20:56:42.786994+0000","last_clean":"2024-05-08T20:56:42.786994+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T20:56:42.786994+0000","last_undegraded":"2024-05-08T20:56:42.786994+0000","last_fullsized":"2024-05-08T20:56:42.786994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793733+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:56:42.793733+0000","last_peered":"2024-05-08T20:56:42.793733+0000","last_clean":"2024-05-08T20:56:42.793733+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:56:42.793733+0000","last_undegraded":"2024-05-08T20:56:42.793733+0000","last_fullsized":"2024-05-08T20:56:42.793733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273347+0000","last_change":"2024-05-08T20:56:41.806254+0000","last_active":"2024-05-08T20:56:43.273347+0000","last_peered":"2024-05-08T20:56:43.273347+0000","last_clean":"2024-05-08T20:56:43.273347+0000","last_became_active":"2024-05-08T20:56:41.806015+0000","last_became_peered":"2024-05-08T20:56:41.806015+0000","last_unstale":"2024-05-08T20:56:43.273347+0000","last_undegraded":"2024-05-08T20:56:43.273347+0000","last_fullsized":"2024-05-08T20:56:43.273347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T20:56:41.789181+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:56:41.789181+0000","last_peered":"2024-05-08T20:56:41.789181+0000","last_clean":"2024-05-08T20:56:41.789181+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:56:41.789181+0000","last_undegraded":"2024-05-08T20:56:41.789181+0000","last_fullsized":"2024-05-08T20:56:41.789181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786683+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:56:42.786683+0000","last_peered":"2024-05-08T20:56:42.786683+0000","last_clean":"2024-05-08T20:56:42.786683+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:56:42.786683+0000","last_undegraded":"2024-05-08T20:56:42.786683+0000","last_fullsized":"2024-05-08T20:56:42.786683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273520+0000","last_change":"2024-05-08T20:56:41.810087+0000","last_active":"2024-05-08T20:56:43.273520+0000","last_peered":"2024-05-08T20:56:43.273520+0000","last_clean":"2024-05-08T20:56:43.273520+0000","last_became_active":"2024-05-08T20:56:41.809880+0000","last_became_peered":"2024-05-08T20:56:41.809880+0000","last_unstale":"2024-05-08T20:56:43.273520+0000","last_undegraded":"2024-05-08T20:56:43.273520+0000","last_fullsized":"2024-05-08T20:56:43.273520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272644+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:56:43.272644+0000","last_peered":"2024-05-08T20:56:43.272644+0000","last_clean":"2024-05-08T20:56:43.272644+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:56:43.272644+0000","last_undegraded":"2024-05-08T20:56:43.272644+0000","last_fullsized":"2024-05-08T20:56:43.272644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272560+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T20:56:43.272560+0000","last_peered":"2024-05-08T20:56:43.272560+0000","last_clean":"2024-05-08T20:56:43.272560+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T20:56:43.272560+0000","last_undegraded":"2024-05-08T20:56:43.272560+0000","last_fullsized":"2024-05-08T20:56:43.272560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793515+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T20:56:42.793515+0000","last_peered":"2024-05-08T20:56:42.793515+0000","last_clean":"2024-05-08T20:56:42.793515+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T20:56:42.793515+0000","last_undegraded":"2024-05-08T20:56:42.793515+0000","last_fullsized":"2024-05-08T20:56:42.793515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785850+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T20:56:42.785850+0000","last_peered":"2024-05-08T20:56:42.785850+0000","last_clean":"2024-05-08T20:56:42.785850+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T20:56:42.785850+0000","last_undegraded":"2024-05-08T20:56:42.785850+0000","last_fullsized":"2024-05-08T20:56:42.785850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786822+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:56:42.786822+0000","last_peered":"2024-05-08T20:56:42.786822+0000","last_clean":"2024-05-08T20:56:42.786822+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:56:42.786822+0000","last_undegraded":"2024-05-08T20:56:42.786822+0000","last_fullsized":"2024-05-08T20:56:42.786822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787954+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T20:56:42.787954+0000","last_peered":"2024-05-08T20:56:42.787954+0000","last_clean":"2024-05-08T20:56:42.787954+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T20:56:42.787954+0000","last_undegraded":"2024-05-08T20:56:42.787954+0000","last_fullsized":"2024-05-08T20:56:42.787954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786292+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:56:42.786292+0000","last_peered":"2024-05-08T20:56:42.786292+0000","last_clean":"2024-05-08T20:56:42.786292+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:56:42.786292+0000","last_undegraded":"2024-05-08T20:56:42.786292+0000","last_fullsized":"2024-05-08T20:56:42.786292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787425+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T20:56:42.787425+0000","last_peered":"2024-05-08T20:56:42.787425+0000","last_clean":"2024-05-08T20:56:42.787425+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T20:56:42.787425+0000","last_undegraded":"2024-05-08T20:56:42.787425+0000","last_fullsized":"2024-05-08T20:56:42.787425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273904+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:56:43.273904+0000","last_peered":"2024-05-08T20:56:43.273904+0000","last_clean":"2024-05-08T20:56:43.273904+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:56:43.273904+0000","last_undegraded":"2024-05-08T20:56:43.273904+0000","last_fullsized":"2024-05-08T20:56:43.273904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786509+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T20:56:42.786509+0000","last_peered":"2024-05-08T20:56:42.786509+0000","last_clean":"2024-05-08T20:56:42.786509+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T20:56:42.786509+0000","last_undegraded":"2024-05-08T20:56:42.786509+0000","last_fullsized":"2024-05-08T20:56:42.786509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786450+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T20:56:42.786450+0000","last_peered":"2024-05-08T20:56:42.786450+0000","last_clean":"2024-05-08T20:56:42.786450+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T20:56:42.786450+0000","last_undegraded":"2024-05-08T20:56:42.786450+0000","last_fullsized":"2024-05-08T20:56:42.786450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274410+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T20:56:43.274410+0000","last_peered":"2024-05-08T20:56:43.274410+0000","last_clean":"2024-05-08T20:56:43.274410+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T20:56:43.274410+0000","last_undegraded":"2024-05-08T20:56:43.274410+0000","last_fullsized":"2024-05-08T20:56:43.274410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043769+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T20:56:43.043769+0000","last_peered":"2024-05-08T20:56:43.043769+0000","last_clean":"2024-05-08T20:56:43.043769+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T20:56:43.043769+0000","last_undegraded":"2024-05-08T20:56:43.043769+0000","last_fullsized":"2024-05-08T20:56:43.043769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.275110+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T20:56:43.275110+0000","last_peered":"2024-05-08T20:56:43.275110+0000","last_clean":"2024-05-08T20:56:43.275110+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T20:56:43.275110+0000","last_undegraded":"2024-05-08T20:56:43.275110+0000","last_fullsized":"2024-05-08T20:56:43.275110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272611+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:56:43.272611+0000","last_peered":"2024-05-08T20:56:43.272611+0000","last_clean":"2024-05-08T20:56:43.272611+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:56:43.272611+0000","last_undegraded":"2024-05-08T20:56:43.272611+0000","last_fullsized":"2024-05-08T20:56:43.272611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787774+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T20:56:42.787774+0000","last_peered":"2024-05-08T20:56:42.787774+0000","last_clean":"2024-05-08T20:56:42.787774+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T20:56:42.787774+0000","last_undegraded":"2024-05-08T20:56:42.787774+0000","last_fullsized":"2024-05-08T20:56:42.787774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785954+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:56:42.785954+0000","last_peered":"2024-05-08T20:56:42.785954+0000","last_clean":"2024-05-08T20:56:42.785954+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:56:42.785954+0000","last_undegraded":"2024-05-08T20:56:42.785954+0000","last_fullsized":"2024-05-08T20:56:42.785954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273075+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T20:56:43.273075+0000","last_peered":"2024-05-08T20:56:43.273075+0000","last_clean":"2024-05-08T20:56:43.273075+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T20:56:43.273075+0000","last_undegraded":"2024-05-08T20:56:43.273075+0000","last_fullsized":"2024-05-08T20:56:43.273075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786223+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:56:42.786223+0000","last_peered":"2024-05-08T20:56:42.786223+0000","last_clean":"2024-05-08T20:56:42.786223+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:56:42.786223+0000","last_undegraded":"2024-05-08T20:56:42.786223+0000","last_fullsized":"2024-05-08T20:56:42.786223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274284+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T20:56:43.274284+0000","last_peered":"2024-05-08T20:56:43.274284+0000","last_clean":"2024-05-08T20:56:43.274284+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T20:56:43.274284+0000","last_undegraded":"2024-05-08T20:56:43.274284+0000","last_fullsized":"2024-05-08T20:56:43.274284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273439+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:56:43.273439+0000","last_peered":"2024-05-08T20:56:43.273439+0000","last_clean":"2024-05-08T20:56:43.273439+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:56:43.273439+0000","last_undegraded":"2024-05-08T20:56:43.273439+0000","last_fullsized":"2024-05-08T20:56:43.273439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043061+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T20:56:43.043061+0000","last_peered":"2024-05-08T20:56:43.043061+0000","last_clean":"2024-05-08T20:56:43.043061+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T20:56:43.043061+0000","last_undegraded":"2024-05-08T20:56:43.043061+0000","last_fullsized":"2024-05-08T20:56:43.043061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787405+0000","last_change":"2024-05-08T20:56:41.808438+0000","last_active":"2024-05-08T20:56:42.787405+0000","last_peered":"2024-05-08T20:56:42.787405+0000","last_clean":"2024-05-08T20:56:42.787405+0000","last_became_active":"2024-05-08T20:56:41.808198+0000","last_became_peered":"2024-05-08T20:56:41.808198+0000","last_unstale":"2024-05-08T20:56:42.787405+0000","last_undegraded":"2024-05-08T20:56:42.787405+0000","last_fullsized":"2024-05-08T20:56:42.787405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273235+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:56:43.273235+0000","last_peered":"2024-05-08T20:56:43.273235+0000","last_clean":"2024-05-08T20:56:43.273235+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:56:43.273235+0000","last_undegraded":"2024-05-08T20:56:43.273235+0000","last_fullsized":"2024-05-08T20:56:43.273235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787094+0000","last_change":"2024-05-08T20:56:41.809061+0000","last_active":"2024-05-08T20:56:42.787094+0000","last_peered":"2024-05-08T20:56:42.787094+0000","last_clean":"2024-05-08T20:56:42.787094+0000","last_became_active":"2024-05-08T20:56:41.808633+0000","last_became_peered":"2024-05-08T20:56:41.808633+0000","last_unstale":"2024-05-08T20:56:42.787094+0000","last_undegraded":"2024-05-08T20:56:42.787094+0000","last_fullsized":"2024-05-08T20:56:42.787094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273650+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T20:56:43.273650+0000","last_peered":"2024-05-08T20:56:43.273650+0000","last_clean":"2024-05-08T20:56:43.273650+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T20:56:43.273650+0000","last_undegraded":"2024-05-08T20:56:43.273650+0000","last_fullsized":"2024-05-08T20:56:43.273650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273560+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T20:56:43.273560+0000","last_peered":"2024-05-08T20:56:43.273560+0000","last_clean":"2024-05-08T20:56:43.273560+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T20:56:43.273560+0000","last_undegraded":"2024-05-08T20:56:43.273560+0000","last_fullsized":"2024-05-08T20:56:43.273560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274424+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:56:43.274424+0000","last_peered":"2024-05-08T20:56:43.274424+0000","last_clean":"2024-05-08T20:56:43.274424+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:56:43.274424+0000","last_undegraded":"2024-05-08T20:56:43.274424+0000","last_fullsized":"2024-05-08T20:56:43.274424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T20:56:43.273978+0000","last_peered":"2024-05-08T20:56:43.273978+0000","last_clean":"2024-05-08T20:56:43.273978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T20:56:43.273978+0000","last_undegraded":"2024-05-08T20:56:43.273978+0000","last_fullsized":"2024-05-08T20:56:43.273978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":654585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6360000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:56:45.835 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:56:45.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f92be700 1 Processor -- start 2024-05-08T20:56:45.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f92be700 1 -- start start 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f92be700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec03e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f92be700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec03c070 con 0x7fe2ec057e40 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f92be700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ec0e36e0 con 0x7fe2ec054460 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f92be700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec058390 con 0x7fe2ec0e3300 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f37fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe2ec057e40 0x7fe2ec053d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55696/0 (socket says 172.21.15.107:55696) 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.944+0000 7fe2f37fe700 1 -- 172.21.15.107:0/2459363315 learned_addr learned my addr 172.21.15.107:0/2459363315 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f3fff700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec03e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331739622 0 0) 0x7fe2ec03c070 con 0x7fe2ec057e40 2024-05-08T20:56:45.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2dc0035d0 con 0x7fe2ec057e40 2024-05-08T20:56:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703047144 0 0) 0x7fe2e4001110 con 0x7fe2ec054460 2024-05-08T20:56:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2ec03c070 con 0x7fe2ec054460 2024-05-08T20:56:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1104097798 0 0) 0x7fe2dc0035d0 con 0x7fe2ec057e40 2024-05-08T20:56:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 msgr2=0x7fe2ec03e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec03e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 >> v1:172.21.15.195:6789/0 conn(0x7fe2ec054460 legacy=0x7fe2ec0ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec058670 con 0x7fe2ec057e40 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7fe2f404ec20 con 0x7fe2ec057e40 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 >> v1:172.21.15.107:6789/0 conn(0x7fe2ec057e40 legacy=0x7fe2ec053d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2dc003be0 0x7fe2dc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2dc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2dc004db0 0x7fe2dc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec058390 con 0x7fe2dc003be0 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00ba30 con 0x7fe2dc004db0 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc00bbf0 con 0x7fe2ec0e3300 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f3fff700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2dc003be0 0x7fe2dc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2dc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f8abd700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2dc004db0 0x7fe2dc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 -- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2dc004db0 msgr2=0x7fe2dc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2dc004db0 0x7fe2dc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 -- 172.21.15.107:0/2459363315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2dc003be0 msgr2=0x7fe2dc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2dc003be0 0x7fe2dc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 -- 172.21.15.107:0/2459363315 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc0035d0 con 0x7fe2ec0e3300 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f37fe700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2dc004870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4067950 tx=0x7fe2dc0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=192ec7a637b0451d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4072130 con 0x7fe2ec0e3300 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40722b0 con 0x7fe2ec0e3300 2024-05-08T20:56:45.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f2ffd700 1 -- 172.21.15.107:0/2459363315 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4072660 con 0x7fe2ec0e3300 2024-05-08T20:56:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f92be700 1 -- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 msgr2=0x7fe2dc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2459363315 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2dc004870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4067950 tx=0x7fe2dc0058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f8abd700 1 -- 172.21.15.107:0/2459363315 reap_dead start 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f92be700 1 -- 172.21.15.107:0/2459363315 shutdown_connections 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f92be700 1 -- 172.21.15.107:0/2459363315 >> 172.21.15.107:0/2459363315 conn(0x7fe2ec055a90 msgr2=0x7fe2ec055ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f92be700 1 -- 172.21.15.107:0/2459363315 shutdown_connections 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.948+0000 7fe2f92be700 1 -- 172.21.15.107:0/2459363315 wait complete. 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 Processor -- start 2024-05-08T20:56:45.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 -- start start 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec04ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2ec0daa40 0x7fe2ec0dee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 0x7fe2ec0e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0db7e0 con 0x7fe2ec0e2760 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec0d8ff0 con 0x7fe2ec0daa40 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ec04f150 con 0x7fe2ec0e3300 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 0x7fe2ec0e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 0x7fe2ec0e4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40352/0 (socket says 172.21.15.107:40352) 2024-05-08T20:56:45.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 -- 172.21.15.107:0/2057195121 learned_addr learned my addr 172.21.15.107:0/2057195121 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f3fff700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec04ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f37fe700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2ec0daa40 0x7fe2ec0dee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 -- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 msgr2=0x7fe2ec04ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec04ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 -- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2ec0daa40 msgr2=0x7fe2ec0dee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2ec0daa40 0x7fe2ec0dee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 -- 172.21.15.107:0/2057195121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec0daf40 con 0x7fe2ec0e2760 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f37fe700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2ec0daa40 0x7fe2ec0dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f8abd700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 0x7fe2ec0e4fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0569e0 tx=0x7fe2e400e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40050d0 con 0x7fe2ec0e2760 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4005270 con 0x7fe2ec0e2760 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec0db220 con 0x7fe2ec0e2760 2024-05-08T20:56:45.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4006880 con 0x7fe2ec0e2760 2024-05-08T20:56:45.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.952+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec0df340 con 0x7fe2ec0e2760 2024-05-08T20:56:45.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.956+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec005890 con 0x7fe2ec0e2760 2024-05-08T20:56:45.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.956+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2e40069e0 con 0x7fe2ec0e2760 2024-05-08T20:56:45.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.956+0000 7fe2f0ff9700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2e0066760 0x7fe2e0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:45.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.956+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2e4082ad0 con 0x7fe2ec0e2760 2024-05-08T20:56:45.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.956+0000 7fe2f3fff700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2e0066760 0x7fe2e0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:45.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.956+0000 7fe2f3fff700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2e0066760 0x7fe2e0068c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009bd0 tx=0x7fe2e8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:45.970 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:45.964+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe2e404fed0 con 0x7fe2ec0e2760 2024-05-08T20:56:46.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.132+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2ec006250 con 0x7fe2e0066760 2024-05-08T20:56:46.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.144+0000 7fe2f0ff9700 1 -- 172.21.15.107:0/2057195121 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264609 (secure 0 0 0) 0x7fe2e8019070 con 0x7fe2e0066760 2024-05-08T20:56:46.157 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:46.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2e0066760 msgr2=0x7fe2e0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2e0066760 0x7fe2e0068c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009bd0 tx=0x7fe2e8009240 comp rx=0 tx=0).stop 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 msgr2=0x7fe2ec0e4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 0x7fe2ec0e4fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0569e0 tx=0x7fe2e400e860 comp rx=0 tx=0).stop 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 shutdown_connections 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2ec0e2760 0x7fe2ec0e4fe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2ec0daa40 0x7fe2ec0dee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2e0066760 0x7fe2e0068c20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 --2- 172.21.15.107:0/2057195121 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2ec0e3300 0x7fe2ec04ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 >> 172.21.15.107:0/2057195121 conn(0x7fe2ec055a90 msgr2=0x7fe2ec04f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 shutdown_connections 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.148+0000 7fe2f92be700 1 -- 172.21.15.107:0/2057195121 wait complete. 2024-05-08T20:56:46.160 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T20:56:46.171 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-08T20:56:44.697366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235356,"kb_used_data":2772,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739364,"statfs":{"total":773094113280,"available":772853108736,"internally_reserved":0,"allocated":2838528,"data_stored":1726425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":238014010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.311801"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273716+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T20:56:43.273716+0000","last_peered":"2024-05-08T20:56:43.273716+0000","last_clean":"2024-05-08T20:56:43.273716+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T20:56:43.273716+0000","last_undegraded":"2024-05-08T20:56:43.273716+0000","last_fullsized":"2024-05-08T20:56:43.273716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786417+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T20:56:42.786417+0000","last_peered":"2024-05-08T20:56:42.786417+0000","last_clean":"2024-05-08T20:56:42.786417+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T20:56:42.786417+0000","last_undegraded":"2024-05-08T20:56:42.786417+0000","last_fullsized":"2024-05-08T20:56:42.786417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273684+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T20:56:43.273684+0000","last_peered":"2024-05-08T20:56:43.273684+0000","last_clean":"2024-05-08T20:56:43.273684+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T20:56:43.273684+0000","last_undegraded":"2024-05-08T20:56:43.273684+0000","last_fullsized":"2024-05-08T20:56:43.273684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786779+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T20:56:42.786779+0000","last_peered":"2024-05-08T20:56:42.786779+0000","last_clean":"2024-05-08T20:56:42.786779+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T20:56:42.786779+0000","last_undegraded":"2024-05-08T20:56:42.786779+0000","last_fullsized":"2024-05-08T20:56:42.786779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273146+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T20:56:43.273146+0000","last_peered":"2024-05-08T20:56:43.273146+0000","last_clean":"2024-05-08T20:56:43.273146+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T20:56:43.273146+0000","last_undegraded":"2024-05-08T20:56:43.273146+0000","last_fullsized":"2024-05-08T20:56:43.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786495+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T20:56:42.786495+0000","last_peered":"2024-05-08T20:56:42.786495+0000","last_clean":"2024-05-08T20:56:42.786495+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T20:56:42.786495+0000","last_undegraded":"2024-05-08T20:56:42.786495+0000","last_fullsized":"2024-05-08T20:56:42.786495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272601+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T20:56:43.272601+0000","last_peered":"2024-05-08T20:56:43.272601+0000","last_clean":"2024-05-08T20:56:43.272601+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T20:56:43.272601+0000","last_undegraded":"2024-05-08T20:56:43.272601+0000","last_fullsized":"2024-05-08T20:56:43.272601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273717+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T20:56:43.273717+0000","last_peered":"2024-05-08T20:56:43.273717+0000","last_clean":"2024-05-08T20:56:43.273717+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T20:56:43.273717+0000","last_undegraded":"2024-05-08T20:56:43.273717+0000","last_fullsized":"2024-05-08T20:56:43.273717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043718+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T20:56:43.043718+0000","last_peered":"2024-05-08T20:56:43.043718+0000","last_clean":"2024-05-08T20:56:43.043718+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T20:56:43.043718+0000","last_undegraded":"2024-05-08T20:56:43.043718+0000","last_fullsized":"2024-05-08T20:56:43.043718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043303+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T20:56:43.043303+0000","last_peered":"2024-05-08T20:56:43.043303+0000","last_clean":"2024-05-08T20:56:43.043303+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T20:56:43.043303+0000","last_undegraded":"2024-05-08T20:56:43.043303+0000","last_fullsized":"2024-05-08T20:56:43.043303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788169+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T20:56:42.788169+0000","last_peered":"2024-05-08T20:56:42.788169+0000","last_clean":"2024-05-08T20:56:42.788169+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T20:56:42.788169+0000","last_undegraded":"2024-05-08T20:56:42.788169+0000","last_fullsized":"2024-05-08T20:56:42.788169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274034+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T20:56:43.274034+0000","last_peered":"2024-05-08T20:56:43.274034+0000","last_clean":"2024-05-08T20:56:43.274034+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T20:56:43.274034+0000","last_undegraded":"2024-05-08T20:56:43.274034+0000","last_fullsized":"2024-05-08T20:56:43.274034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273554+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T20:56:43.273554+0000","last_peered":"2024-05-08T20:56:43.273554+0000","last_clean":"2024-05-08T20:56:43.273554+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T20:56:43.273554+0000","last_undegraded":"2024-05-08T20:56:43.273554+0000","last_fullsized":"2024-05-08T20:56:43.273554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785960+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T20:56:42.785960+0000","last_peered":"2024-05-08T20:56:42.785960+0000","last_clean":"2024-05-08T20:56:42.785960+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T20:56:42.785960+0000","last_undegraded":"2024-05-08T20:56:42.785960+0000","last_fullsized":"2024-05-08T20:56:42.785960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786454+0000","last_change":"2024-05-08T20:56:41.791132+0000","last_active":"2024-05-08T20:56:42.786454+0000","last_peered":"2024-05-08T20:56:42.786454+0000","last_clean":"2024-05-08T20:56:42.786454+0000","last_became_active":"2024-05-08T20:56:41.790838+0000","last_became_peered":"2024-05-08T20:56:41.790838+0000","last_unstale":"2024-05-08T20:56:42.786454+0000","last_undegraded":"2024-05-08T20:56:42.786454+0000","last_fullsized":"2024-05-08T20:56:42.786454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787321+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T20:56:42.787321+0000","last_peered":"2024-05-08T20:56:42.787321+0000","last_clean":"2024-05-08T20:56:42.787321+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T20:56:42.787321+0000","last_undegraded":"2024-05-08T20:56:42.787321+0000","last_fullsized":"2024-05-08T20:56:42.787321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793458+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T20:56:42.793458+0000","last_peered":"2024-05-08T20:56:42.793458+0000","last_clean":"2024-05-08T20:56:42.793458+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T20:56:42.793458+0000","last_undegraded":"2024-05-08T20:56:42.793458+0000","last_fullsized":"2024-05-08T20:56:42.793458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273673+0000","last_change":"2024-05-08T20:56:41.802323+0000","last_active":"2024-05-08T20:56:43.273673+0000","last_peered":"2024-05-08T20:56:43.273673+0000","last_clean":"2024-05-08T20:56:43.273673+0000","last_became_active":"2024-05-08T20:56:41.798890+0000","last_became_peered":"2024-05-08T20:56:41.798890+0000","last_unstale":"2024-05-08T20:56:43.273673+0000","last_undegraded":"2024-05-08T20:56:43.273673+0000","last_fullsized":"2024-05-08T20:56:43.273673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043301+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.043301+0000","last_peered":"2024-05-08T20:56:43.043301+0000","last_clean":"2024-05-08T20:56:43.043301+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.043301+0000","last_undegraded":"2024-05-08T20:56:43.043301+0000","last_fullsized":"2024-05-08T20:56:43.043301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273478+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T20:56:43.273478+0000","last_peered":"2024-05-08T20:56:43.273478+0000","last_clean":"2024-05-08T20:56:43.273478+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T20:56:43.273478+0000","last_undegraded":"2024-05-08T20:56:43.273478+0000","last_fullsized":"2024-05-08T20:56:43.273478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786653+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T20:56:42.786653+0000","last_peered":"2024-05-08T20:56:42.786653+0000","last_clean":"2024-05-08T20:56:42.786653+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T20:56:42.786653+0000","last_undegraded":"2024-05-08T20:56:42.786653+0000","last_fullsized":"2024-05-08T20:56:42.786653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272750+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T20:56:43.272750+0000","last_peered":"2024-05-08T20:56:43.272750+0000","last_clean":"2024-05-08T20:56:43.272750+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T20:56:43.272750+0000","last_undegraded":"2024-05-08T20:56:43.272750+0000","last_fullsized":"2024-05-08T20:56:43.272750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786490+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T20:56:42.786490+0000","last_peered":"2024-05-08T20:56:42.786490+0000","last_clean":"2024-05-08T20:56:42.786490+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T20:56:42.786490+0000","last_undegraded":"2024-05-08T20:56:42.786490+0000","last_fullsized":"2024-05-08T20:56:42.786490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274272+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T20:56:43.274272+0000","last_peered":"2024-05-08T20:56:43.274272+0000","last_clean":"2024-05-08T20:56:43.274272+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T20:56:43.274272+0000","last_undegraded":"2024-05-08T20:56:43.274272+0000","last_fullsized":"2024-05-08T20:56:43.274272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043789+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T20:56:43.043789+0000","last_peered":"2024-05-08T20:56:43.043789+0000","last_clean":"2024-05-08T20:56:43.043789+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T20:56:43.043789+0000","last_undegraded":"2024-05-08T20:56:43.043789+0000","last_fullsized":"2024-05-08T20:56:43.043789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786283+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T20:56:42.786283+0000","last_peered":"2024-05-08T20:56:42.786283+0000","last_clean":"2024-05-08T20:56:42.786283+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T20:56:42.786283+0000","last_undegraded":"2024-05-08T20:56:42.786283+0000","last_fullsized":"2024-05-08T20:56:42.786283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274673+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.274673+0000","last_peered":"2024-05-08T20:56:43.274673+0000","last_clean":"2024-05-08T20:56:43.274673+0000","last_became_active":"2024-05-08T20:56:41.810632+0000","last_became_peered":"2024-05-08T20:56:41.810632+0000","last_unstale":"2024-05-08T20:56:43.274673+0000","last_undegraded":"2024-05-08T20:56:43.274673+0000","last_fullsized":"2024-05-08T20:56:43.274673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273719+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T20:56:43.273719+0000","last_peered":"2024-05-08T20:56:43.273719+0000","last_clean":"2024-05-08T20:56:43.273719+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T20:56:43.273719+0000","last_undegraded":"2024-05-08T20:56:43.273719+0000","last_fullsized":"2024-05-08T20:56:43.273719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787815+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T20:56:42.787815+0000","last_peered":"2024-05-08T20:56:42.787815+0000","last_clean":"2024-05-08T20:56:42.787815+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T20:56:42.787815+0000","last_undegraded":"2024-05-08T20:56:42.787815+0000","last_fullsized":"2024-05-08T20:56:42.787815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793490+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T20:56:42.793490+0000","last_peered":"2024-05-08T20:56:42.793490+0000","last_clean":"2024-05-08T20:56:42.793490+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T20:56:42.793490+0000","last_undegraded":"2024-05-08T20:56:42.793490+0000","last_fullsized":"2024-05-08T20:56:42.793490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042896+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T20:56:43.042896+0000","last_peered":"2024-05-08T20:56:43.042896+0000","last_clean":"2024-05-08T20:56:43.042896+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T20:56:43.042896+0000","last_undegraded":"2024-05-08T20:56:43.042896+0000","last_fullsized":"2024-05-08T20:56:43.042896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787032+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T20:56:42.787032+0000","last_peered":"2024-05-08T20:56:42.787032+0000","last_clean":"2024-05-08T20:56:42.787032+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T20:56:42.787032+0000","last_undegraded":"2024-05-08T20:56:42.787032+0000","last_fullsized":"2024-05-08T20:56:42.787032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274508+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:56:43.274508+0000","last_peered":"2024-05-08T20:56:43.274508+0000","last_clean":"2024-05-08T20:56:43.274508+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:56:43.274508+0000","last_undegraded":"2024-05-08T20:56:43.274508+0000","last_fullsized":"2024-05-08T20:56:43.274508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043109+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:56:43.043109+0000","last_peered":"2024-05-08T20:56:43.043109+0000","last_clean":"2024-05-08T20:56:43.043109+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:56:43.043109+0000","last_undegraded":"2024-05-08T20:56:43.043109+0000","last_fullsized":"2024-05-08T20:56:43.043109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273264+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:56:43.273264+0000","last_peered":"2024-05-08T20:56:43.273264+0000","last_clean":"2024-05-08T20:56:43.273264+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:56:43.273264+0000","last_undegraded":"2024-05-08T20:56:43.273264+0000","last_fullsized":"2024-05-08T20:56:43.273264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272849+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T20:56:43.272849+0000","last_peered":"2024-05-08T20:56:43.272849+0000","last_clean":"2024-05-08T20:56:43.272849+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T20:56:43.272849+0000","last_undegraded":"2024-05-08T20:56:43.272849+0000","last_fullsized":"2024-05-08T20:56:43.272849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:56:42.786560+0000","last_peered":"2024-05-08T20:56:42.786560+0000","last_clean":"2024-05-08T20:56:42.786560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:56:42.786560+0000","last_undegraded":"2024-05-08T20:56:42.786560+0000","last_fullsized":"2024-05-08T20:56:42.786560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785898+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T20:56:42.785898+0000","last_peered":"2024-05-08T20:56:42.785898+0000","last_clean":"2024-05-08T20:56:42.785898+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T20:56:42.785898+0000","last_undegraded":"2024-05-08T20:56:42.785898+0000","last_fullsized":"2024-05-08T20:56:42.785898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043678+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:56:43.043678+0000","last_peered":"2024-05-08T20:56:43.043678+0000","last_clean":"2024-05-08T20:56:43.043678+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:56:43.043678+0000","last_undegraded":"2024-05-08T20:56:43.043678+0000","last_fullsized":"2024-05-08T20:56:43.043678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787265+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T20:56:42.787265+0000","last_peered":"2024-05-08T20:56:42.787265+0000","last_clean":"2024-05-08T20:56:42.787265+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T20:56:42.787265+0000","last_undegraded":"2024-05-08T20:56:42.787265+0000","last_fullsized":"2024-05-08T20:56:42.787265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787227+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:56:42.787227+0000","last_peered":"2024-05-08T20:56:42.787227+0000","last_clean":"2024-05-08T20:56:42.787227+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:56:42.787227+0000","last_undegraded":"2024-05-08T20:56:42.787227+0000","last_fullsized":"2024-05-08T20:56:42.787227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273777+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T20:56:43.273777+0000","last_peered":"2024-05-08T20:56:43.273777+0000","last_clean":"2024-05-08T20:56:43.273777+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T20:56:43.273777+0000","last_undegraded":"2024-05-08T20:56:43.273777+0000","last_fullsized":"2024-05-08T20:56:43.273777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786449+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T20:56:42.786449+0000","last_peered":"2024-05-08T20:56:42.786449+0000","last_clean":"2024-05-08T20:56:42.786449+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T20:56:42.786449+0000","last_undegraded":"2024-05-08T20:56:42.786449+0000","last_fullsized":"2024-05-08T20:56:42.786449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788239+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T20:56:42.788239+0000","last_peered":"2024-05-08T20:56:42.788239+0000","last_clean":"2024-05-08T20:56:42.788239+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T20:56:42.788239+0000","last_undegraded":"2024-05-08T20:56:42.788239+0000","last_fullsized":"2024-05-08T20:56:42.788239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043359+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:56:43.043359+0000","last_peered":"2024-05-08T20:56:43.043359+0000","last_clean":"2024-05-08T20:56:43.043359+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:56:43.043359+0000","last_undegraded":"2024-05-08T20:56:43.043359+0000","last_fullsized":"2024-05-08T20:56:43.043359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273305+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T20:56:43.273305+0000","last_peered":"2024-05-08T20:56:43.273305+0000","last_clean":"2024-05-08T20:56:43.273305+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T20:56:43.273305+0000","last_undegraded":"2024-05-08T20:56:43.273305+0000","last_fullsized":"2024-05-08T20:56:43.273305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273945+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:56:43.273945+0000","last_peered":"2024-05-08T20:56:43.273945+0000","last_clean":"2024-05-08T20:56:43.273945+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:56:43.273945+0000","last_undegraded":"2024-05-08T20:56:43.273945+0000","last_fullsized":"2024-05-08T20:56:43.273945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273114+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T20:56:43.273114+0000","last_peered":"2024-05-08T20:56:43.273114+0000","last_clean":"2024-05-08T20:56:43.273114+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T20:56:43.273114+0000","last_undegraded":"2024-05-08T20:56:43.273114+0000","last_fullsized":"2024-05-08T20:56:43.273114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786739+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:56:42.786739+0000","last_peered":"2024-05-08T20:56:42.786739+0000","last_clean":"2024-05-08T20:56:42.786739+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:56:42.786739+0000","last_undegraded":"2024-05-08T20:56:42.786739+0000","last_fullsized":"2024-05-08T20:56:42.786739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273150+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T20:56:43.273150+0000","last_peered":"2024-05-08T20:56:43.273150+0000","last_clean":"2024-05-08T20:56:43.273150+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T20:56:43.273150+0000","last_undegraded":"2024-05-08T20:56:43.273150+0000","last_fullsized":"2024-05-08T20:56:43.273150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042994+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:56:43.042994+0000","last_peered":"2024-05-08T20:56:43.042994+0000","last_clean":"2024-05-08T20:56:43.042994+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:56:43.042994+0000","last_undegraded":"2024-05-08T20:56:43.042994+0000","last_fullsized":"2024-05-08T20:56:43.042994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042960+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T20:56:43.042960+0000","last_peered":"2024-05-08T20:56:43.042960+0000","last_clean":"2024-05-08T20:56:43.042960+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T20:56:43.042960+0000","last_undegraded":"2024-05-08T20:56:43.042960+0000","last_fullsized":"2024-05-08T20:56:43.042960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793237+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:56:42.793237+0000","last_peered":"2024-05-08T20:56:42.793237+0000","last_clean":"2024-05-08T20:56:42.793237+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:56:42.793237+0000","last_undegraded":"2024-05-08T20:56:42.793237+0000","last_fullsized":"2024-05-08T20:56:42.793237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787710+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:56:42.787710+0000","last_peered":"2024-05-08T20:56:42.787710+0000","last_clean":"2024-05-08T20:56:42.787710+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:56:42.787710+0000","last_undegraded":"2024-05-08T20:56:42.787710+0000","last_fullsized":"2024-05-08T20:56:42.787710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273687+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T20:56:43.273687+0000","last_peered":"2024-05-08T20:56:43.273687+0000","last_clean":"2024-05-08T20:56:43.273687+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T20:56:43.273687+0000","last_undegraded":"2024-05-08T20:56:43.273687+0000","last_fullsized":"2024-05-08T20:56:43.273687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793472+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:56:42.793472+0000","last_peered":"2024-05-08T20:56:42.793472+0000","last_clean":"2024-05-08T20:56:42.793472+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:56:42.793472+0000","last_undegraded":"2024-05-08T20:56:42.793472+0000","last_fullsized":"2024-05-08T20:56:42.793472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273910+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T20:56:43.273910+0000","last_peered":"2024-05-08T20:56:43.273910+0000","last_clean":"2024-05-08T20:56:43.273910+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T20:56:43.273910+0000","last_undegraded":"2024-05-08T20:56:43.273910+0000","last_fullsized":"2024-05-08T20:56:43.273910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786606+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:56:42.786606+0000","last_peered":"2024-05-08T20:56:42.786606+0000","last_clean":"2024-05-08T20:56:42.786606+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:56:42.786606+0000","last_undegraded":"2024-05-08T20:56:42.786606+0000","last_fullsized":"2024-05-08T20:56:42.786606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786994+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T20:56:42.786994+0000","last_peered":"2024-05-08T20:56:42.786994+0000","last_clean":"2024-05-08T20:56:42.786994+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T20:56:42.786994+0000","last_undegraded":"2024-05-08T20:56:42.786994+0000","last_fullsized":"2024-05-08T20:56:42.786994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793733+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:56:42.793733+0000","last_peered":"2024-05-08T20:56:42.793733+0000","last_clean":"2024-05-08T20:56:42.793733+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:56:42.793733+0000","last_undegraded":"2024-05-08T20:56:42.793733+0000","last_fullsized":"2024-05-08T20:56:42.793733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273347+0000","last_change":"2024-05-08T20:56:41.806254+0000","last_active":"2024-05-08T20:56:43.273347+0000","last_peered":"2024-05-08T20:56:43.273347+0000","last_clean":"2024-05-08T20:56:43.273347+0000","last_became_active":"2024-05-08T20:56:41.806015+0000","last_became_peered":"2024-05-08T20:56:41.806015+0000","last_unstale":"2024-05-08T20:56:43.273347+0000","last_undegraded":"2024-05-08T20:56:43.273347+0000","last_fullsized":"2024-05-08T20:56:43.273347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T20:56:41.789181+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:56:41.789181+0000","last_peered":"2024-05-08T20:56:41.789181+0000","last_clean":"2024-05-08T20:56:41.789181+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:56:41.789181+0000","last_undegraded":"2024-05-08T20:56:41.789181+0000","last_fullsized":"2024-05-08T20:56:41.789181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786683+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:56:42.786683+0000","last_peered":"2024-05-08T20:56:42.786683+0000","last_clean":"2024-05-08T20:56:42.786683+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:56:42.786683+0000","last_undegraded":"2024-05-08T20:56:42.786683+0000","last_fullsized":"2024-05-08T20:56:42.786683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273520+0000","last_change":"2024-05-08T20:56:41.810087+0000","last_active":"2024-05-08T20:56:43.273520+0000","last_peered":"2024-05-08T20:56:43.273520+0000","last_clean":"2024-05-08T20:56:43.273520+0000","last_became_active":"2024-05-08T20:56:41.809880+0000","last_became_peered":"2024-05-08T20:56:41.809880+0000","last_unstale":"2024-05-08T20:56:43.273520+0000","last_undegraded":"2024-05-08T20:56:43.273520+0000","last_fullsized":"2024-05-08T20:56:43.273520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272644+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:56:43.272644+0000","last_peered":"2024-05-08T20:56:43.272644+0000","last_clean":"2024-05-08T20:56:43.272644+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:56:43.272644+0000","last_undegraded":"2024-05-08T20:56:43.272644+0000","last_fullsized":"2024-05-08T20:56:43.272644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272560+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T20:56:43.272560+0000","last_peered":"2024-05-08T20:56:43.272560+0000","last_clean":"2024-05-08T20:56:43.272560+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T20:56:43.272560+0000","last_undegraded":"2024-05-08T20:56:43.272560+0000","last_fullsized":"2024-05-08T20:56:43.272560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793515+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T20:56:42.793515+0000","last_peered":"2024-05-08T20:56:42.793515+0000","last_clean":"2024-05-08T20:56:42.793515+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T20:56:42.793515+0000","last_undegraded":"2024-05-08T20:56:42.793515+0000","last_fullsized":"2024-05-08T20:56:42.793515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785850+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T20:56:42.785850+0000","last_peered":"2024-05-08T20:56:42.785850+0000","last_clean":"2024-05-08T20:56:42.785850+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T20:56:42.785850+0000","last_undegraded":"2024-05-08T20:56:42.785850+0000","last_fullsized":"2024-05-08T20:56:42.785850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786822+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:56:42.786822+0000","last_peered":"2024-05-08T20:56:42.786822+0000","last_clean":"2024-05-08T20:56:42.786822+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:56:42.786822+0000","last_undegraded":"2024-05-08T20:56:42.786822+0000","last_fullsized":"2024-05-08T20:56:42.786822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787954+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T20:56:42.787954+0000","last_peered":"2024-05-08T20:56:42.787954+0000","last_clean":"2024-05-08T20:56:42.787954+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T20:56:42.787954+0000","last_undegraded":"2024-05-08T20:56:42.787954+0000","last_fullsized":"2024-05-08T20:56:42.787954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786292+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:56:42.786292+0000","last_peered":"2024-05-08T20:56:42.786292+0000","last_clean":"2024-05-08T20:56:42.786292+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:56:42.786292+0000","last_undegraded":"2024-05-08T20:56:42.786292+0000","last_fullsized":"2024-05-08T20:56:42.786292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787425+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T20:56:42.787425+0000","last_peered":"2024-05-08T20:56:42.787425+0000","last_clean":"2024-05-08T20:56:42.787425+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T20:56:42.787425+0000","last_undegraded":"2024-05-08T20:56:42.787425+0000","last_fullsized":"2024-05-08T20:56:42.787425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273904+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:56:43.273904+0000","last_peered":"2024-05-08T20:56:43.273904+0000","last_clean":"2024-05-08T20:56:43.273904+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:56:43.273904+0000","last_undegraded":"2024-05-08T20:56:43.273904+0000","last_fullsized":"2024-05-08T20:56:43.273904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786509+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T20:56:42.786509+0000","last_peered":"2024-05-08T20:56:42.786509+0000","last_clean":"2024-05-08T20:56:42.786509+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T20:56:42.786509+0000","last_undegraded":"2024-05-08T20:56:42.786509+0000","last_fullsized":"2024-05-08T20:56:42.786509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786450+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T20:56:42.786450+0000","last_peered":"2024-05-08T20:56:42.786450+0000","last_clean":"2024-05-08T20:56:42.786450+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T20:56:42.786450+0000","last_undegraded":"2024-05-08T20:56:42.786450+0000","last_fullsized":"2024-05-08T20:56:42.786450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274410+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T20:56:43.274410+0000","last_peered":"2024-05-08T20:56:43.274410+0000","last_clean":"2024-05-08T20:56:43.274410+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T20:56:43.274410+0000","last_undegraded":"2024-05-08T20:56:43.274410+0000","last_fullsized":"2024-05-08T20:56:43.274410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043769+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T20:56:43.043769+0000","last_peered":"2024-05-08T20:56:43.043769+0000","last_clean":"2024-05-08T20:56:43.043769+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T20:56:43.043769+0000","last_undegraded":"2024-05-08T20:56:43.043769+0000","last_fullsized":"2024-05-08T20:56:43.043769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.275110+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T20:56:43.275110+0000","last_peered":"2024-05-08T20:56:43.275110+0000","last_clean":"2024-05-08T20:56:43.275110+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T20:56:43.275110+0000","last_undegraded":"2024-05-08T20:56:43.275110+0000","last_fullsized":"2024-05-08T20:56:43.275110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272611+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:56:43.272611+0000","last_peered":"2024-05-08T20:56:43.272611+0000","last_clean":"2024-05-08T20:56:43.272611+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:56:43.272611+0000","last_undegraded":"2024-05-08T20:56:43.272611+0000","last_fullsized":"2024-05-08T20:56:43.272611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787774+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T20:56:42.787774+0000","last_peered":"2024-05-08T20:56:42.787774+0000","last_clean":"2024-05-08T20:56:42.787774+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T20:56:42.787774+0000","last_undegraded":"2024-05-08T20:56:42.787774+0000","last_fullsized":"2024-05-08T20:56:42.787774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785954+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:56:42.785954+0000","last_peered":"2024-05-08T20:56:42.785954+0000","last_clean":"2024-05-08T20:56:42.785954+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:56:42.785954+0000","last_undegraded":"2024-05-08T20:56:42.785954+0000","last_fullsized":"2024-05-08T20:56:42.785954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273075+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T20:56:43.273075+0000","last_peered":"2024-05-08T20:56:43.273075+0000","last_clean":"2024-05-08T20:56:43.273075+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T20:56:43.273075+0000","last_undegraded":"2024-05-08T20:56:43.273075+0000","last_fullsized":"2024-05-08T20:56:43.273075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786223+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:56:42.786223+0000","last_peered":"2024-05-08T20:56:42.786223+0000","last_clean":"2024-05-08T20:56:42.786223+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:56:42.786223+0000","last_undegraded":"2024-05-08T20:56:42.786223+0000","last_fullsized":"2024-05-08T20:56:42.786223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274284+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T20:56:43.274284+0000","last_peered":"2024-05-08T20:56:43.274284+0000","last_clean":"2024-05-08T20:56:43.274284+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T20:56:43.274284+0000","last_undegraded":"2024-05-08T20:56:43.274284+0000","last_fullsized":"2024-05-08T20:56:43.274284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273439+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:56:43.273439+0000","last_peered":"2024-05-08T20:56:43.273439+0000","last_clean":"2024-05-08T20:56:43.273439+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:56:43.273439+0000","last_undegraded":"2024-05-08T20:56:43.273439+0000","last_fullsized":"2024-05-08T20:56:43.273439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043061+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T20:56:43.043061+0000","last_peered":"2024-05-08T20:56:43.043061+0000","last_clean":"2024-05-08T20:56:43.043061+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T20:56:43.043061+0000","last_undegraded":"2024-05-08T20:56:43.043061+0000","last_fullsized":"2024-05-08T20:56:43.043061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787405+0000","last_change":"2024-05-08T20:56:41.808438+0000","last_active":"2024-05-08T20:56:42.787405+0000","last_peered":"2024-05-08T20:56:42.787405+0000","last_clean":"2024-05-08T20:56:42.787405+0000","last_became_active":"2024-05-08T20:56:41.808198+0000","last_became_peered":"2024-05-08T20:56:41.808198+0000","last_unstale":"2024-05-08T20:56:42.787405+0000","last_undegraded":"2024-05-08T20:56:42.787405+0000","last_fullsized":"2024-05-08T20:56:42.787405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273235+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:56:43.273235+0000","last_peered":"2024-05-08T20:56:43.273235+0000","last_clean":"2024-05-08T20:56:43.273235+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:56:43.273235+0000","last_undegraded":"2024-05-08T20:56:43.273235+0000","last_fullsized":"2024-05-08T20:56:43.273235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787094+0000","last_change":"2024-05-08T20:56:41.809061+0000","last_active":"2024-05-08T20:56:42.787094+0000","last_peered":"2024-05-08T20:56:42.787094+0000","last_clean":"2024-05-08T20:56:42.787094+0000","last_became_active":"2024-05-08T20:56:41.808633+0000","last_became_peered":"2024-05-08T20:56:41.808633+0000","last_unstale":"2024-05-08T20:56:42.787094+0000","last_undegraded":"2024-05-08T20:56:42.787094+0000","last_fullsized":"2024-05-08T20:56:42.787094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273650+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T20:56:43.273650+0000","last_peered":"2024-05-08T20:56:43.273650+0000","last_clean":"2024-05-08T20:56:43.273650+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T20:56:43.273650+0000","last_undegraded":"2024-05-08T20:56:43.273650+0000","last_fullsized":"2024-05-08T20:56:43.273650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273560+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T20:56:43.273560+0000","last_peered":"2024-05-08T20:56:43.273560+0000","last_clean":"2024-05-08T20:56:43.273560+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T20:56:43.273560+0000","last_undegraded":"2024-05-08T20:56:43.273560+0000","last_fullsized":"2024-05-08T20:56:43.273560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274424+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:56:43.274424+0000","last_peered":"2024-05-08T20:56:43.274424+0000","last_clean":"2024-05-08T20:56:43.274424+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:56:43.274424+0000","last_undegraded":"2024-05-08T20:56:43.274424+0000","last_fullsized":"2024-05-08T20:56:43.274424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T20:56:43.273978+0000","last_peered":"2024-05-08T20:56:43.273978+0000","last_clean":"2024-05-08T20:56:43.273978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T20:56:43.273978+0000","last_undegraded":"2024-05-08T20:56:43.273978+0000","last_fullsized":"2024-05-08T20:56:43.273978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":790528,"data_stored":655548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.546}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":654585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6360000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:56:46.176 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T20:56:46.176 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T20:56:46.176 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T20:56:46.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T20:56:46.177 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T20:56:46.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 Processor -- start 2024-05-08T20:56:46.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 -- start start 2024-05-08T20:56:46.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb1dc06ba80 0x7fb1dc06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb1dc06e2e0 0x7fb1dc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc06d590 con 0x7fb1dc1596a0 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc06e750 con 0x7fb1dc06e2e0 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e304c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc06c980 con 0x7fb1dc06ba80 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e204a700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb1dc1596a0 0x7fb1dc06b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:55702/0 (socket says 172.21.15.107:55702) 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e204a700 1 -- 172.21.15.107:0/3470222934 learned_addr learned my addr 172.21.15.107:0/3470222934 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e284b700 1 --2- 172.21.15.107:0/3470222934 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc06e2e0 0x7fb1dc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.288+0000 7fb1e1849700 1 --2- 172.21.15.107:0/3470222934 >> v2:172.21.15.195:3300/0 conn(0x7fb1dc06ba80 0x7fb1dc06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1048700 1 -- 172.21.15.107:0/3470222934 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751037463 0 0) 0x7fb1dc06d590 con 0x7fb1dc1596a0 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1048700 1 -- 172.21.15.107:0/3470222934 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c80046e0 con 0x7fb1dc1596a0 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1849700 1 -- 172.21.15.107:0/3470222934 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc06e2e0 msgr2=0x7fb1dc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1849700 1 --2- 172.21.15.107:0/3470222934 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc06e2e0 0x7fb1dc0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1849700 1 -- 172.21.15.107:0/3470222934 >> v1:172.21.15.107:6789/0 conn(0x7fb1dc1596a0 legacy=0x7fb1dc06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1849700 1 -- 172.21.15.107:0/3470222934 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc06cc60 con 0x7fb1dc06ba80 2024-05-08T20:56:46.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e284b700 1 --2- 172.21.15.107:0/3470222934 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc06e2e0 0x7fb1dc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1849700 1 --2- 172.21.15.107:0/3470222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06ba80 0x7fb1dc06dda0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc066b00 tx=0x7fb1cc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94fecb187396a2f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1048700 1 -- 172.21.15.107:0/3470222934 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011830 con 0x7fb1dc06ba80 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1048700 1 -- 172.21.15.107:0/3470222934 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc011990 con 0x7fb1dc06ba80 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e1048700 1 -- 172.21.15.107:0/3470222934 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011d20 con 0x7fb1dc06ba80 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 -- 172.21.15.107:0/3470222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06ba80 msgr2=0x7fb1dc06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 --2- 172.21.15.107:0/3470222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06ba80 0x7fb1dc06dda0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc066b00 tx=0x7fb1cc009b30 comp rx=0 tx=0).stop 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 -- 172.21.15.107:0/3470222934 shutdown_connections 2024-05-08T20:56:46.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 --2- 172.21.15.107:0/3470222934 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc06e2e0 0x7fb1dc0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 --2- 172.21.15.107:0/3470222934 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06ba80 0x7fb1dc06dda0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 -- 172.21.15.107:0/3470222934 >> 172.21.15.107:0/3470222934 conn(0x7fb1dc070960 msgr2=0x7fb1dc070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:46.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 -- 172.21.15.107:0/3470222934 shutdown_connections 2024-05-08T20:56:46.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.292+0000 7fb1e304c700 1 -- 172.21.15.107:0/3470222934 wait complete. 2024-05-08T20:56:46.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 Processor -- start 2024-05-08T20:56:46.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 -- start start 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc06ba80 0x7fb1dc14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06e2e0 0x7fb1dc15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 0x7fb1dc151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0c8a30 con 0x7fb1dc1596a0 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15c450 con 0x7fb1dc06e2e0 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.296+0000 7fb1e304c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15c6f0 con 0x7fb1dc06ba80 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 0x7fb1dc151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 0x7fb1dc151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:40368/0 (socket says 172.21.15.107:40368) 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 -- 172.21.15.107:0/1717092907 learned_addr learned my addr 172.21.15.107:0/1717092907 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:46.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e204a700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc06ba80 0x7fb1dc14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e1849700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06e2e0 0x7fb1dc15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 -- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc06ba80 msgr2=0x7fb1dc14e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc06ba80 0x7fb1dc14e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 -- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06e2e0 msgr2=0x7fb1dc15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06e2e0 0x7fb1dc15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 -- 172.21.15.107:0/1717092907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4009a70 con 0x7fb1dc1596a0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e284b700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 0x7fb1dc151b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400efc0 tx=0x7fb1d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400ca90 con 0x7fb1dc1596a0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400f040 con 0x7fb1dc1596a0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc0094b0 con 0x7fb1dc1596a0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400ce10 con 0x7fb1dc1596a0 2024-05-08T20:56:46.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc14ee00 con 0x7fb1dc1596a0 2024-05-08T20:56:46.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc0c8ee0 con 0x7fb1dc1596a0 2024-05-08T20:56:46.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1d4014480 con 0x7fb1dc1596a0 2024-05-08T20:56:46.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1d2ffd700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c0066730 0x7fb1c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1e204a700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c0066730 0x7fb1c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.300+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1d4084790 con 0x7fb1dc1596a0 2024-05-08T20:56:46.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.304+0000 7fb1e204a700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c0066730 0x7fb1c0068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8007fd0 tx=0x7fb1d8007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.308+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb1dc0c8ee0 con 0x7fb1dc1596a0 2024-05-08T20:56:46.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.516+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb1dc0c8ee0 con 0x7fb1dc1596a0 2024-05-08T20:56:46.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.520+0000 7fb1d2ffd700 1 -- 172.21.15.107:0/1717092907 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164891 (secure 0 0 0) 0x7fb1dc0c8ee0 con 0x7fb1dc1596a0 2024-05-08T20:56:46.531 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c0066730 msgr2=0x7fb1c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c0066730 0x7fb1c0068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8007fd0 tx=0x7fb1d8007de0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 msgr2=0x7fb1dc151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 0x7fb1dc151b50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400efc0 tx=0x7fb1d400c3a0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 shutdown_connections 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc1596a0 0x7fb1dc151b50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1dc06e2e0 0x7fb1dc15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c0066730 0x7fb1c0068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 --2- 172.21.15.107:0/1717092907 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc06ba80 0x7fb1dc14e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 >> 172.21.15.107:0/1717092907 conn(0x7fb1dc070960 msgr2=0x7fb1dc1587a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:46.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 shutdown_connections 2024-05-08T20:56:46.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.524+0000 7fb1e304c700 1 -- 172.21.15.107:0/1717092907 wait complete. 2024-05-08T20:56:46.544 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":25996},{"type":"v1","addr":"172.21.15.107:6833","nonce":25996}]},"active_addr":"172.21.15.107:6833/25996","active_change":"2024-05-08T20:56:22.682924+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":4175298112}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3270542465}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3391554979}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":324066408}]}]} 2024-05-08T20:56:46.548 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T20:56:46.548 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T20:56:46.549 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:46.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 Processor -- start 2024-05-08T20:56:46.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 -- start start 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffa8c0b3c20 0x7ffa8c1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa8c070110 0x7ffa8c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa8c158960 con 0x7ffa8c071e70 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c0b1f60 con 0x7ffa8c070110 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8b59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8c0ae990 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.652+0000 7ffa8ad9d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa8c070110 0x7ffa8c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ffa8c070110 0x7ffa8c0705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50488/0 (socket says 172.21.15.107:50488) 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8a59c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffa8c0b3c20 0x7ffa8c1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/3233989884 learned_addr learned my addr 172.21.15.107:0/3233989884 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:46.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/3233989884 >> v2:172.21.15.195:3300/0 conn(0x7ffa8c0b3c20 msgr2=0x7ffa8c1624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:46.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 --2- 172.21.15.107:0/3233989884 >> v2:172.21.15.195:3300/0 conn(0x7ffa8c0b3c20 0x7ffa8c1624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/3233989884 >> v1:172.21.15.195:6789/0 conn(0x7ffa8c071e70 legacy=0x7ffa8c0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/3233989884 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c0b2170 con 0x7ffa8c070110 2024-05-08T20:56:46.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8ad9d700 1 --2- 172.21.15.107:0/3233989884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c070110 0x7ffa8c0705a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c06eba0 tx=0x7ffa8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f687318b717283d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa89d9b700 1 -- 172.21.15.107:0/3233989884 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400e070 con 0x7ffa8c070110 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa89d9b700 1 -- 172.21.15.107:0/3233989884 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400b910 con 0x7ffa8c070110 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa89d9b700 1 -- 172.21.15.107:0/3233989884 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400bcc0 con 0x7ffa8c070110 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 -- 172.21.15.107:0/3233989884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c070110 msgr2=0x7ffa8c0705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/3233989884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c070110 0x7ffa8c0705a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c06eba0 tx=0x7ffa8400b330 comp rx=0 tx=0).stop 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 -- 172.21.15.107:0/3233989884 shutdown_connections 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/3233989884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c070110 0x7ffa8c0705a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/3233989884 >> v2:172.21.15.195:3300/0 conn(0x7ffa8c0b3c20 0x7ffa8c1624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 -- 172.21.15.107:0/3233989884 >> 172.21.15.107:0/3233989884 conn(0x7ffa8c06c330 msgr2=0x7ffa8c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 -- 172.21.15.107:0/3233989884 shutdown_connections 2024-05-08T20:56:46.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.656+0000 7ffa8b59e700 1 -- 172.21.15.107:0/3233989884 wait complete. 2024-05-08T20:56:46.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 Processor -- start 2024-05-08T20:56:46.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 -- start start 2024-05-08T20:56:46.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa8c070110 0x7ffa8c1f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c071e70 0x7ffa8c0a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 0x7ffa8c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0a97c0 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0a9aa0 con 0x7ffa8c071e70 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8b59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8c0a9d80 con 0x7ffa8c070110 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 0x7ffa8c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8a59c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa8c070110 0x7ffa8c1f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa81d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c071e70 0x7ffa8c0a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 0x7ffa8c0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50492/0 (socket says 172.21.15.107:50492) 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8a59c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa8c070110 0x7ffa8c1f73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53648/0 (socket says 172.21.15.107:53648) 2024-05-08T20:56:46.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/2642383188 learned_addr learned my addr 172.21.15.107:0/2642383188 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:46.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/2642383188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa8c070110 msgr2=0x7ffa8c1f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa8c070110 0x7ffa8c1f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/2642383188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c071e70 msgr2=0x7ffa8c0a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c071e70 0x7ffa8c0a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 -- 172.21.15.107:0/2642383188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa84009b30 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa8ad9d700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 0x7ffa8c0ad6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c06b120 tx=0x7ffa84004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.660+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa84004880 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.664+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa840099b0 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.664+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8c0ab780 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.664+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8401b670 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.664+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8c1f7930 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.664+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8c0abc40 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.664+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa8401b7d0 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.668+0000 7ffa837fe700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffa70066760 0x7ffa70068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.668+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa84085900 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.668+0000 7ffa8a59c700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffa70066760 0x7ffa70068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.668+0000 7ffa8a59c700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffa70066760 0x7ffa70068c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009b50 tx=0x7ffa7c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.672+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ffa84052d00 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.848+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa8c0684b0 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.848+0000 7ffa837fe700 1 -- 172.21.15.107:0/2642383188 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ffa84056320 con 0x7ffa8c0b3c20 2024-05-08T20:56:46.857 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:46.857 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:42.773336+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffa70066760 msgr2=0x7ffa70068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffa70066760 0x7ffa70068c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009b50 tx=0x7ffa7c009240 comp rx=0 tx=0).stop 2024-05-08T20:56:46.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 msgr2=0x7ffa8c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 0x7ffa8c0ad6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c06b120 tx=0x7ffa84004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 shutdown_connections 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffa8c0b3c20 0x7ffa8c0ad6f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffa8c071e70 0x7ffa8c0a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffa70066760 0x7ffa70068c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 --2- 172.21.15.107:0/2642383188 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffa8c070110 0x7ffa8c1f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 >> 172.21.15.107:0/2642383188 conn(0x7ffa8c06c330 msgr2=0x7ffa8c157350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 shutdown_connections 2024-05-08T20:56:46.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.852+0000 7ffa8b59e700 1 -- 172.21.15.107:0/2642383188 wait complete. 2024-05-08T20:56:46.872 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T20:56:46.873 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:46.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.980+0000 7fc9a2f5e700 1 Processor -- start 2024-05-08T20:56:46.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.980+0000 7fc9a2f5e700 1 -- start start 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc99c06ba80 0x7fc99c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc99c0b2610 0x7fc99c06c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0ae1f0 con 0x7fc99c15d190 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0ad5e0 con 0x7fc99c0b2610 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0ad8c0 con 0x7fc99c06ba80 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a1f5c700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc99c15d190 0x7fc99c06b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60890/0 (socket says 172.21.15.107:60890) 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a1f5c700 1 -- 172.21.15.107:0/838263955 learned_addr learned my addr 172.21.15.107:0/838263955 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a275d700 1 --2- 172.21.15.107:0/838263955 >> v2:172.21.15.107:3300/0 conn(0x7fc99c0b2610 0x7fc99c06c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a175b700 1 --2- 172.21.15.107:0/838263955 >> v2:172.21.15.195:3300/0 conn(0x7fc99c06ba80 0x7fc99c0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a0f5a700 1 -- 172.21.15.107:0/838263955 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750205871 0 0) 0x7fc99c0ae1f0 con 0x7fc99c15d190 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a0f5a700 1 -- 172.21.15.107:0/838263955 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9880035d0 con 0x7fc99c15d190 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a275d700 1 -- 172.21.15.107:0/838263955 >> v2:172.21.15.195:3300/0 conn(0x7fc99c06ba80 msgr2=0x7fc99c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a275d700 1 --2- 172.21.15.107:0/838263955 >> v2:172.21.15.195:3300/0 conn(0x7fc99c06ba80 0x7fc99c0ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a275d700 1 -- 172.21.15.107:0/838263955 >> v1:172.21.15.107:6789/0 conn(0x7fc99c15d190 legacy=0x7fc99c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a275d700 1 -- 172.21.15.107:0/838263955 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0adba0 con 0x7fc99c0b2610 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a275d700 1 --2- 172.21.15.107:0/838263955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c0b2610 0x7fc99c06c980 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc99c06e940 tx=0x7fc99400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92ccc1c53691568 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a0f5a700 1 -- 172.21.15.107:0/838263955 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400e070 con 0x7fc99c0b2610 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a0f5a700 1 -- 172.21.15.107:0/838263955 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400bb20 con 0x7fc99c0b2610 2024-05-08T20:56:46.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a0f5a700 1 -- 172.21.15.107:0/838263955 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994012430 con 0x7fc99c0b2610 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/838263955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c0b2610 msgr2=0x7fc99c06c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/838263955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c0b2610 0x7fc99c06c980 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc99c06e940 tx=0x7fc99400b330 comp rx=0 tx=0).stop 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/838263955 shutdown_connections 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/838263955 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c0b2610 0x7fc99c06c980 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/838263955 >> v2:172.21.15.195:3300/0 conn(0x7fc99c06ba80 0x7fc99c0ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.984+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/838263955 >> 172.21.15.107:0/838263955 conn(0x7fc99c070960 msgr2=0x7fc99c070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/838263955 shutdown_connections 2024-05-08T20:56:46.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/838263955 wait complete. 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 Processor -- start 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 -- start start 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 0x7fc99c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc99c0b2610 0x7fc99c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc99c15d190 0x7fc99c15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c159100 con 0x7fc99c06ba80 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c15e740 con 0x7fc99c0b2610 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a2f5e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c15ea20 con 0x7fc99c15d190 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a1f5c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 0x7fc99c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:46.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a1f5c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 0x7fc99c154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50504/0 (socket says 172.21.15.107:50504) 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a1f5c700 1 -- 172.21.15.107:0/2576715302 learned_addr learned my addr 172.21.15.107:0/2576715302 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a175b700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc99c0b2610 0x7fc99c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.988+0000 7fc9a275d700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc99c15d190 0x7fc99c15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a1f5c700 1 -- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc99c15d190 msgr2=0x7fc99c15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a1f5c700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc99c15d190 0x7fc99c15eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a1f5c700 1 -- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc99c0b2610 msgr2=0x7fc99c1f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a1f5c700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc99c0b2610 0x7fc99c1f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a1f5c700 1 -- 172.21.15.107:0/2576715302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994009a70 con 0x7fc99c06ba80 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a275d700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc99c15d190 0x7fc99c15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a1f5c700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 0x7fc99c154070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc99800c4d0 tx=0x7fc99800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998005d90 con 0x7fc99c06ba80 2024-05-08T20:56:47.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9980070d0 con 0x7fc99c06ba80 2024-05-08T20:56:47.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c1545b0 con 0x7fc99c06ba80 2024-05-08T20:56:47.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998007480 con 0x7fc99c06ba80 2024-05-08T20:56:47.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c1f35b0 con 0x7fc99c06ba80 2024-05-08T20:56:47.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c0672a0 con 0x7fc99c06ba80 2024-05-08T20:56:47.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9980075e0 con 0x7fc99c06ba80 2024-05-08T20:56:47.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9927fc700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc980066760 0x7fc980068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9a175b700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc980066760 0x7fc980068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.992+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc998083560 con 0x7fc99c06ba80 2024-05-08T20:56:47.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:46.996+0000 7fc9a175b700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc980066760 0x7fc980068c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc99c072a90 tx=0x7fc98c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.000+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc998050960 con 0x7fc99c06ba80 2024-05-08T20:56:47.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.172+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc99c071590 con 0x7fc99c06ba80 2024-05-08T20:56:47.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.176+0000 7fc9927fc700 1 -- 172.21.15.107:0/2576715302 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fc998053f80 con 0x7fc99c06ba80 2024-05-08T20:56:47.185 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:47.185 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:42.773336+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc980066760 msgr2=0x7fc980068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc980066760 0x7fc980068c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc99c072a90 tx=0x7fc98c009240 comp rx=0 tx=0).stop 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 msgr2=0x7fc99c154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 0x7fc99c154070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc99800c4d0 tx=0x7fc99800c7e0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 shutdown_connections 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc980066760 0x7fc980068c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc99c15d190 0x7fc99c15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc99c0b2610 0x7fc99c1f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 --2- 172.21.15.107:0/2576715302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc99c06ba80 0x7fc99c154070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 >> 172.21.15.107:0/2576715302 conn(0x7fc99c070960 msgr2=0x7fc99c06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 shutdown_connections 2024-05-08T20:56:47.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.180+0000 7fc9a2f5e700 1 -- 172.21.15.107:0/2576715302 wait complete. 2024-05-08T20:56:47.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T20:56:47.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T20:56:47.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T20:56:47.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T20:56:47.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T20:56:47.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T20:56:47.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T20:56:47.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T20:56:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 Processor -- start 2024-05-08T20:56:47.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 -- start start 2024-05-08T20:56:47.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7fd45759e700 1 Processor -- start 2024-05-08T20:56:47.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10240b3c20 0x7f10241624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7fd45759e700 1 -- start start 2024-05-08T20:56:47.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 0x7f10240705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1024158960 con 0x7f1024071e70 2024-05-08T20:56:47.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240b1f60 con 0x7f10240b3c20 2024-05-08T20:56:47.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f102a74b700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10240ae990 con 0x7f1024070110 2024-05-08T20:56:47.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f1193c20700 1 Processor -- start 2024-05-08T20:56:47.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f1193c20700 1 -- start start 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.344+0000 7f1029f4a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 0x7f10240705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 0x7f10240705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53666/0 (socket says 172.21.15.107:53666) 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 -- 172.21.15.107:0/2065105255 learned_addr learned my addr 172.21.15.107:0/2065105255 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029749700 1 --2- 172.21.15.107:0/2065105255 >> v2:172.21.15.195:3300/0 conn(0x7f10240b3c20 0x7f10241624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 -- 172.21.15.107:0/2065105255 >> v2:172.21.15.195:3300/0 conn(0x7f10240b3c20 msgr2=0x7f10241624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 --2- 172.21.15.107:0/2065105255 >> v2:172.21.15.195:3300/0 conn(0x7f10240b3c20 0x7f10241624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 -- 172.21.15.107:0/2065105255 >> v1:172.21.15.195:6789/0 conn(0x7f1024071e70 legacy=0x7f10240b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 -- 172.21.15.107:0/2065105255 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240b2170 con 0x7f1024070110 2024-05-08T20:56:47.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45759e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd458160c80 0x7fd458161060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f118c16e660 0x7f118c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45759e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580b2740 con 0x7fd4580ac8e0 2024-05-08T20:56:47.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45759e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45806d990 con 0x7fd4580b1f60 2024-05-08T20:56:47.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45759e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458146d60 con 0x7fd458160c80 2024-05-08T20:56:47.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1029f4a700 1 --2- 172.21.15.107:0/2065105255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 0x7f10240705a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f101c009e50 tx=0x7f101c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=975a99ba9cdd4634 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd455d9b700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd4580b1f60 0x7fd45806e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50050/0 (socket says 172.21.15.107:50050) 2024-05-08T20:56:47.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd455d9b700 1 -- 172.21.15.107:0/2520716364 learned_addr learned my addr 172.21.15.107:0/2520716364 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:47.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f118c071970 0x7f118c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c16aef0 con 0x7f118c167b90 2024-05-08T20:56:47.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c16a600 con 0x7f118c16e660 2024-05-08T20:56:47.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c16b380 con 0x7f118c071970 2024-05-08T20:56:47.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f118c16e660 0x7f118c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45659c700 1 --2- 172.21.15.107:0/2520716364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd458160c80 0x7fd458161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f118c16e660 0x7f118c06d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50516/0 (socket says 172.21.15.107:50516) 2024-05-08T20:56:47.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 -- 172.21.15.107:0/233138720 learned_addr learned my addr 172.21.15.107:0/233138720 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11921bd700 1 --2- 172.21.15.107:0/233138720 >> v2:172.21.15.195:3300/0 conn(0x7f118c071970 0x7f118c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 -- 172.21.15.107:0/233138720 >> v2:172.21.15.195:3300/0 conn(0x7f118c071970 msgr2=0x7f118c06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 Processor -- start 2024-05-08T20:56:47.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45659c700 1 -- 172.21.15.107:0/2520716364 >> v1:172.21.15.195:6789/0 conn(0x7fd4580b1f60 legacy=0x7fd45806e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45659c700 1 -- 172.21.15.107:0/2520716364 >> v1:172.21.15.107:6789/0 conn(0x7fd4580ac8e0 legacy=0x7fd4580acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45659c700 1 -- 172.21.15.107:0/2520716364 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4581615a0 con 0x7fd458160c80 2024-05-08T20:56:47.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 --2- 172.21.15.107:0/233138720 >> v2:172.21.15.195:3300/0 conn(0x7f118c071970 0x7f118c06dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 -- 172.21.15.107:0/233138720 >> v1:172.21.15.195:6789/0 conn(0x7f118c167b90 legacy=0x7f118c071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 -- 172.21.15.107:0/233138720 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c16a8a0 con 0x7f118c16e660 2024-05-08T20:56:47.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11921bd700 1 --2- 172.21.15.107:0/233138720 >> v2:172.21.15.195:3300/0 conn(0x7f118c071970 0x7f118c06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:47.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11919bc700 1 --2- 172.21.15.107:0/233138720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c16e660 0x7f118c06d670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f118c06e590 tx=0x7f118400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ac27c2441cc42e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f101bfff700 1 -- 172.21.15.107:0/2065105255 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00e070 con 0x7f1024070110 2024-05-08T20:56:47.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f101bfff700 1 -- 172.21.15.107:0/2065105255 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c00b910 con 0x7f1024070110 2024-05-08T20:56:47.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f101bfff700 1 -- 172.21.15.107:0/2065105255 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c00bcc0 con 0x7f1024070110 2024-05-08T20:56:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11909ba700 1 -- 172.21.15.107:0/233138720 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400e070 con 0x7f118c16e660 2024-05-08T20:56:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11909ba700 1 -- 172.21.15.107:0/233138720 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1184003a40 con 0x7f118c16e660 2024-05-08T20:56:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f11909ba700 1 -- 172.21.15.107:0/233138720 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184003df0 con 0x7f118c16e660 2024-05-08T20:56:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 -- start start 2024-05-08T20:56:47.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 -- 172.21.15.107:0/2065105255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 msgr2=0x7f10240705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 --2- 172.21.15.107:0/2065105255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 0x7f10240705a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f101c009e50 tx=0x7f101c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- 172.21.15.107:0/233138720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c16e660 msgr2=0x7f118c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 Processor -- start 2024-05-08T20:56:47.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 -- start start 2024-05-08T20:56:47.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 --2- 172.21.15.107:0/233138720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c16e660 0x7f118c06d670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f118c06e590 tx=0x7f118400b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45659c700 1 --2- 172.21.15.107:0/2520716364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd458160c80 0x7fd458161060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd448009880 tx=0x7fd448009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a11a4e6b87be6004 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 -- 172.21.15.107:0/2065105255 shutdown_connections 2024-05-08T20:56:47.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 --2- 172.21.15.107:0/2065105255 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024070110 0x7f10240705a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 --2- 172.21.15.107:0/2065105255 >> v2:172.21.15.195:3300/0 conn(0x7f10240b3c20 0x7f10241624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 -- 172.21.15.107:0/2065105255 >> 172.21.15.107:0/2065105255 conn(0x7f102406c330 msgr2=0x7f102406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45559a700 1 -- 172.21.15.107:0/2520716364 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448010790 con 0x7fd458160c80 2024-05-08T20:56:47.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 -- 172.21.15.107:0/2065105255 shutdown_connections 2024-05-08T20:56:47.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45559a700 1 -- 172.21.15.107:0/2520716364 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4480108f0 con 0x7fd458160c80 2024-05-08T20:56:47.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fd45559a700 1 -- 172.21.15.107:0/2520716364 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448010ca0 con 0x7fd458160c80 2024-05-08T20:56:47.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- 172.21.15.107:0/233138720 shutdown_connections 2024-05-08T20:56:47.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 --2- 172.21.15.107:0/233138720 >> v2:172.21.15.195:3300/0 conn(0x7f118c071970 0x7f118c06dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 --2- 172.21.15.107:0/233138720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c16e660 0x7f118c06d670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- 172.21.15.107:0/233138720 >> 172.21.15.107:0/233138720 conn(0x7f118c0b0cd0 msgr2=0x7f118c0b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f102a74b700 1 -- 172.21.15.107:0/2065105255 wait complete. 2024-05-08T20:56:47.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f1193c20700 1 -- 172.21.15.107:0/233138720 shutdown_connections 2024-05-08T20:56:47.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa234071e70 0x7fa2341624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa234070110 0x7fa2340705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa234158960 con 0x7fa2340b3c20 2024-05-08T20:56:47.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2340b1f60 con 0x7fa234070110 2024-05-08T20:56:47.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa238960700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340ae990 con 0x7fa234071e70 2024-05-08T20:56:47.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa233fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa234070110 0x7fa2340705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa232ffd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa234071e70 0x7fa2341624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa233fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa234070110 0x7fa2340705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50528/0 (socket says 172.21.15.107:50528) 2024-05-08T20:56:47.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7fa233fff700 1 -- 172.21.15.107:0/3027521693 learned_addr learned my addr 172.21.15.107:0/3027521693 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f951ce0f700 1 Processor -- start 2024-05-08T20:56:47.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7f951ce0f700 1 -- start start 2024-05-08T20:56:47.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faae8157b80 0x7faae8071130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae8071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faae80ae1d0 0x7faae80ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae806e8d0 con 0x7faae8157b80 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.348+0000 7faaede40700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae806df30 con 0x7faae80ae1d0 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaede40700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae806e210 con 0x7faae806ecf0 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fa233fff700 1 -- 172.21.15.107:0/3027521693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa234071e70 msgr2=0x7fa2341624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fa233fff700 1 --2- 172.21.15.107:0/3027521693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa234071e70 0x7fa2341624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fa233fff700 1 -- 172.21.15.107:0/3027521693 >> v1:172.21.15.195:6789/0 conn(0x7fa2340b3c20 legacy=0x7fa2340b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fa233fff700 1 -- 172.21.15.107:0/3027521693 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340b2170 con 0x7fa234070110 2024-05-08T20:56:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faae8157b80 0x7faae8071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faae8157b80 0x7faae8071130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50532/0 (socket says 172.21.15.107:50532) 2024-05-08T20:56:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 -- 172.21.15.107:0/1899498496 learned_addr learned my addr 172.21.15.107:0/1899498496 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fa233fff700 1 --2- 172.21.15.107:0/3027521693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234070110 0x7fa2340705a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009e50 tx=0x7fa22c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793c01dcc04ea73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaed63f700 1 --2- 172.21.15.107:0/1899498496 >> v2:172.21.15.195:3300/0 conn(0x7faae80ae1d0 0x7faae80ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- 172.21.15.107:0/2520716364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd458160c80 msgr2=0x7fd458161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 --2- 172.21.15.107:0/2520716364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd458160c80 0x7fd458161060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd448009880 tx=0x7fd448009b90 comp rx=0 tx=0).stop 2024-05-08T20:56:47.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 -- 172.21.15.107:0/233138720 wait complete. 2024-05-08T20:56:47.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- 172.21.15.107:0/2520716364 shutdown_connections 2024-05-08T20:56:47.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 --2- 172.21.15.107:0/2520716364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd458160c80 0x7fd458161060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- 172.21.15.107:0/2520716364 >> 172.21.15.107:0/2520716364 conn(0x7fd4580aebd0 msgr2=0x7fd4580aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 -- 172.21.15.107:0/1899498496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 msgr2=0x7faae8071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 --2- 172.21.15.107:0/1899498496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 -- 172.21.15.107:0/1899498496 >> v2:172.21.15.195:3300/0 conn(0x7faae80ae1d0 msgr2=0x7faae80ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 --2- 172.21.15.107:0/1899498496 >> v2:172.21.15.195:3300/0 conn(0x7faae80ae1d0 0x7faae80ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- 172.21.15.107:0/2520716364 shutdown_connections 2024-05-08T20:56:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 -- 172.21.15.107:0/1899498496 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae806e4f0 con 0x7faae8157b80 2024-05-08T20:56:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- 172.21.15.107:0/2520716364 wait complete. 2024-05-08T20:56:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaece3e700 1 --2- 172.21.15.107:0/1899498496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae8071130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faae80ade50 tx=0x7faadc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32d79d0f07d9c56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faae77fe700 1 -- 172.21.15.107:0/1899498496 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc00b8a0 con 0x7faae8157b80 2024-05-08T20:56:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 Processor -- start 2024-05-08T20:56:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 -- start start 2024-05-08T20:56:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 Processor -- start 2024-05-08T20:56:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- start start 2024-05-08T20:56:47.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faae77fe700 1 -- 172.21.15.107:0/1899498496 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc00ba00 con 0x7faae8157b80 2024-05-08T20:56:47.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faae77fe700 1 -- 172.21.15.107:0/1899498496 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc00bd90 con 0x7faae8157b80 2024-05-08T20:56:47.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaede40700 1 -- 172.21.15.107:0/1899498496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 msgr2=0x7faae8071130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7faaede40700 1 --2- 172.21.15.107:0/1899498496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae8071130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faae80ade50 tx=0x7faadc009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f951ce0f700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f95180b3c20 0x7f95181624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f951ce0f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9518071e70 0x7f95180b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f951ce0f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9518165070 0x7f9518165500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f951ce0f700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180b1f60 con 0x7f9518071e70 2024-05-08T20:56:47.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f951ce0f700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9518158960 con 0x7f95180b3c20 2024-05-08T20:56:47.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f951ce0f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180b4540 con 0x7f9518165070 2024-05-08T20:56:47.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 Processor -- start 2024-05-08T20:56:47.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 -- start start 2024-05-08T20:56:47.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9518071e70 0x7f95180b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9518071e70 0x7f95180b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50542/0 (socket says 172.21.15.107:50542) 2024-05-08T20:56:47.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 -- 172.21.15.107:0/396894811 learned_addr learned my addr 172.21.15.107:0/396894811 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f95177fe700 1 --2- 172.21.15.107:0/396894811 >> v2:172.21.15.195:3300/0 conn(0x7f95180b3c20 0x7f95181624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 -- 172.21.15.107:0/396894811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9518165070 msgr2=0x7f9518165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 --2- 172.21.15.107:0/396894811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9518165070 0x7f9518165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 -- 172.21.15.107:0/396894811 >> v2:172.21.15.195:3300/0 conn(0x7f95180b3c20 msgr2=0x7f95181624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 --2- 172.21.15.107:0/396894811 >> v2:172.21.15.195:3300/0 conn(0x7f95180b3c20 0x7f95181624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 -- 172.21.15.107:0/396894811 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180ae990 con 0x7f9518071e70 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f95177fe700 1 --2- 172.21.15.107:0/396894811 >> v2:172.21.15.195:3300/0 conn(0x7f95180b3c20 0x7f95181624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f9516ffd700 1 --2- 172.21.15.107:0/396894811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f95180b4000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f951806eba0 tx=0x7f951000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965fd78082fd726f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f95167fc700 1 -- 172.21.15.107:0/396894811 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000e070 con 0x7f9518071e70 2024-05-08T20:56:47.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4580ac8e0 0x7fd45813c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4580b1f60 0x7fd4581602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458160c80 0x7fd458143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c071970 0x7f118c210920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458145840 con 0x7fd4580ac8e0 2024-05-08T20:56:47.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458144c30 con 0x7fd458160c80 2024-05-08T20:56:47.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7fd45759e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458144f10 con 0x7fd4580b1f60 2024-05-08T20:56:47.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f95167fc700 1 -- 172.21.15.107:0/396894811 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951000b9c0 con 0x7f9518071e70 2024-05-08T20:56:47.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f95167fc700 1 -- 172.21.15.107:0/396894811 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951000bd70 con 0x7f9518071e70 2024-05-08T20:56:47.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c167b90 0x7f118c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c16e660 0x7f118c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1613a0 con 0x7f118c071970 2024-05-08T20:56:47.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c160790 con 0x7f118c16e660 2024-05-08T20:56:47.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f1193c20700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c160a70 con 0x7f118c167b90 2024-05-08T20:56:47.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa2327fc700 1 -- 172.21.15.107:0/3027521693 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00e070 con 0x7fa234070110 2024-05-08T20:56:47.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa2327fc700 1 -- 172.21.15.107:0/3027521693 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c003a40 con 0x7fa234070110 2024-05-08T20:56:47.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd455d9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4580b1f60 0x7fd4581602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd455d9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4580b1f60 0x7fd4581602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53710/0 (socket says 172.21.15.107:53710) 2024-05-08T20:56:47.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa2327fc700 1 -- 172.21.15.107:0/3027521693 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c003df0 con 0x7fa234070110 2024-05-08T20:56:47.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd455d9b700 1 -- 172.21.15.107:0/1871106831 learned_addr learned my addr 172.21.15.107:0/1871106831 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458160c80 0x7fd458143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c16e660 0x7f118c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c16e660 0x7f118c15a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38470/0 (socket says 172.21.15.107:38470) 2024-05-08T20:56:47.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 -- 172.21.15.107:0/2283340179 learned_addr learned my addr 172.21.15.107:0/2283340179 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 -- 172.21.15.107:0/396894811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 msgr2=0x7f95180b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 --2- 172.21.15.107:0/396894811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f95180b4000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f951806eba0 tx=0x7f951000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1024070110 0x7f10241491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024071e70 0x7f102414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240b3c20 0x7f102414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102414e000 con 0x7f1024070110 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1024149720 con 0x7f10240b3c20 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.352+0000 7f102a74b700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102414d760 con 0x7f1024071e70 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024071e70 0x7f102414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024071e70 0x7f102414ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53720/0 (socket says 172.21.15.107:53720) 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 -- 172.21.15.107:0/738800709 learned_addr learned my addr 172.21.15.107:0/738800709 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd45659c700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4580ac8e0 0x7fd45813c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 -- 172.21.15.107:0/1899498496 shutdown_connections 2024-05-08T20:56:47.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 --2- 172.21.15.107:0/1899498496 >> v2:172.21.15.195:3300/0 conn(0x7faae80ae1d0 0x7faae80ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 --2- 172.21.15.107:0/1899498496 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae8071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 --2- 172.21.15.107:0/1899498496 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae8071130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 -- 172.21.15.107:0/1899498496 >> 172.21.15.107:0/1899498496 conn(0x7faae80cfe10 msgr2=0x7faae80d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1029f4a700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240b3c20 0x7f102414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 -- 172.21.15.107:0/738800709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240b3c20 msgr2=0x7f102414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10240b3c20 0x7f102414e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 -- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1024070110 msgr2=0x7f10241491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1024070110 0x7f10241491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 -- 172.21.15.107:0/738800709 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c009b30 con 0x7f1024071e70 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 -- 172.21.15.107:0/1871106831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4580b1f60 msgr2=0x7fd4581602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd4580b1f60 0x7fd4581602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 -- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4580ac8e0 msgr2=0x7fd45813c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd4580ac8e0 0x7fd45813c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 -- 172.21.15.107:0/1871106831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4480094b0 con 0x7fd458160c80 2024-05-08T20:56:47.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 -- 172.21.15.107:0/3027521693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234070110 msgr2=0x7fa2340705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 --2- 172.21.15.107:0/3027521693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234070110 0x7fa2340705a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009e50 tx=0x7fa22c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1028f48700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024071e70 0x7f102414ce10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f101400c500 tx=0x7f101400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd456d9d700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458160c80 0x7fd458143f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c450 tx=0x7fd44c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0054e0 con 0x7fd458160c80 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4581451f0 con 0x7fd458160c80 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c00ce60 con 0x7fd458160c80 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd458145cd0 con 0x7fd458160c80 2024-05-08T20:56:47.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0038a0 con 0x7fd458160c80 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 -- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c167b90 msgr2=0x7f118c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f118c167b90 0x7f118c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 -- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c071970 msgr2=0x7f118c210920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f118c071970 0x7f118c210920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 -- 172.21.15.107:0/2283340179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009b30 con 0x7f118c16e660 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11921bd700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c16e660 0x7f118c15a300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f118800c7c0 tx=0x7f118800cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011860 con 0x7f118c16e660 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11880119c0 con 0x7f118c16e660 2024-05-08T20:56:47.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011d70 con 0x7f118c16e660 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 -- 172.21.15.107:0/396894811 shutdown_connections 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 --2- 172.21.15.107:0/396894811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9518165070 0x7f9518165500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 --2- 172.21.15.107:0/396894811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f95180b4000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 --2- 172.21.15.107:0/396894811 >> v2:172.21.15.195:3300/0 conn(0x7f95180b3c20 0x7f95181624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 -- 172.21.15.107:0/396894811 >> 172.21.15.107:0/396894811 conn(0x7f951806c330 msgr2=0x7f951806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 -- 172.21.15.107:0/396894811 shutdown_connections 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 -- 172.21.15.107:0/396894811 wait complete. 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 -- 172.21.15.107:0/3027521693 shutdown_connections 2024-05-08T20:56:47.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 --2- 172.21.15.107:0/3027521693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa234071e70 0x7fa2341624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 --2- 172.21.15.107:0/3027521693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234070110 0x7fa2340705a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 -- 172.21.15.107:0/3027521693 >> 172.21.15.107:0/3027521693 conn(0x7fa23406c330 msgr2=0x7fa23406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 -- 172.21.15.107:0/1899498496 shutdown_connections 2024-05-08T20:56:47.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 -- 172.21.15.107:0/1899498496 wait complete. 2024-05-08T20:56:47.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10140052d0 con 0x7f1024071e70 2024-05-08T20:56:47.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1014005430 con 0x7f1024071e70 2024-05-08T20:56:47.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10140055a0 con 0x7f1024071e70 2024-05-08T20:56:47.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 Processor -- start 2024-05-08T20:56:47.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7faaede40700 1 -- start start 2024-05-08T20:56:47.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7fa238960700 1 -- 172.21.15.107:0/3027521693 shutdown_connections 2024-05-08T20:56:47.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1193c20700 1 -- 172.21.15.107:0/2283340179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c160d50 con 0x7f118c16e660 2024-05-08T20:56:47.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f1193c20700 1 -- 172.21.15.107:0/2283340179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c210e60 con 0x7f118c16e660 2024-05-08T20:56:47.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f102a74b700 1 -- 172.21.15.107:0/738800709 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102414da40 con 0x7f1024071e70 2024-05-08T20:56:47.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f102a74b700 1 -- 172.21.15.107:0/738800709 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024154ac0 con 0x7f1024071e70 2024-05-08T20:56:47.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1168000fc0 con 0x7f118c16e660 2024-05-08T20:56:47.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 Processor -- start 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f951ce0f700 1 -- start start 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f9518155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95180b3c20 0x7f951815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9518165070 0x7f951815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518155750 con 0x7f9518071e70 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9518158aa0 con 0x7f9518165070 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9518158d80 con 0x7f95180b3c20 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaede40700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae81f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaede40700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae80ae1d0 0x7faae80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaede40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae806b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaede40700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae81492b0 con 0x7faae8157b80 2024-05-08T20:56:47.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaede40700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae80cee90 con 0x7faae80ae1d0 2024-05-08T20:56:47.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaede40700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae81f8ab0 con 0x7faae806ecf0 2024-05-08T20:56:47.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 -- 172.21.15.107:0/3027521693 wait complete. 2024-05-08T20:56:47.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f9516ffd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95180b3c20 0x7f951815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f9516ffd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95180b3c20 0x7f951815bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53742/0 (socket says 172.21.15.107:53742) 2024-05-08T20:56:47.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f9516ffd700 1 -- 172.21.15.107:0/3742514076 learned_addr learned my addr 172.21.15.107:0/3742514076 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f20ea910700 1 Processor -- start 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.356+0000 7f20ea910700 1 -- start start 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f20e41678d0 0x7f20e416af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e416da50 0x7f20e416de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f20e406d670 0x7f20e406db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e406e040 con 0x7f20e406d670 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e416b460 con 0x7f20e41678d0 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e416e4d0 con 0x7f20e416da50 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e8ead700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f20e406d670 0x7f20e406db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e8ead700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f20e406d670 0x7f20e406db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50594/0 (socket says 172.21.15.107:50594) 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e8ead700 1 -- 172.21.15.107:0/668128880 learned_addr learned my addr 172.21.15.107:0/668128880 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 --2- 172.21.15.107:0/668128880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e416da50 0x7f20e416de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd44c003a00 con 0x7fd458160c80 2024-05-08T20:56:47.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd446ffd700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd438066730 0x7fd438068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd44c083390 con 0x7fd458160c80 2024-05-08T20:56:47.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd45659c700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd438066730 0x7fd438068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd45759e700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7fd43c0015e0 0x7fd43c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 --> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd43c006bf0 con 0x7fd43c0015e0 2024-05-08T20:56:47.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10240b2a10 con 0x7f1024071e70 2024-05-08T20:56:47.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 -- 172.21.15.107:0/668128880 >> v2:172.21.15.195:3300/0 conn(0x7f20e41678d0 msgr2=0x7f20e416af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 --2- 172.21.15.107:0/668128880 >> v2:172.21.15.195:3300/0 conn(0x7f20e41678d0 0x7f20e416af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 -- 172.21.15.107:0/668128880 >> v2:172.21.15.107:3300/0 conn(0x7f20e406d670 msgr2=0x7f20e406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 --2- 172.21.15.107:0/668128880 >> v2:172.21.15.107:3300/0 conn(0x7f20e406d670 0x7f20e406db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 -- 172.21.15.107:0/668128880 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e416e7b0 con 0x7f20e416da50 2024-05-08T20:56:47.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10140038e0 con 0x7f1024071e70 2024-05-08T20:56:47.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd45659c700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd438066730 0x7fd438068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4480097d0 tx=0x7fd448008000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f9518155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f9517fff700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9518165070 0x7f951815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 -- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95180b3c20 msgr2=0x7f951815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f95180b3c20 0x7f951815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11880223e0 con 0x7f118c16e660 2024-05-08T20:56:47.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 -- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9518165070 msgr2=0x7f951815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9518165070 0x7f951815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 -- 172.21.15.107:0/3742514076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009b30 con 0x7f9518071e70 2024-05-08T20:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f9517fff700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9518165070 0x7f951815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f95177fe700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f9518155210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f950800c7f0 tx=0x7f950800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 Processor -- start 2024-05-08T20:56:47.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 -- start start 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaece3e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae81f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaece3e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae81f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53748/0 (socket says 172.21.15.107:53748) 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaece3e700 1 -- 172.21.15.107:0/3270634386 learned_addr learned my addr 172.21.15.107:0/3270634386 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae806b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50584/0 (socket says 172.21.15.107:50584) 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 -- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 msgr2=0x7faae81f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faae806ecf0 0x7faae81f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 -- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae80ae1d0 msgr2=0x7faae80cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae80ae1d0 0x7faae80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 -- 172.21.15.107:0/3270634386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc009570 con 0x7faae8157b80 2024-05-08T20:56:47.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faaed63f700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae806b870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faad800e7e0 tx=0x7faad800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11827fc700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1170066730 0x7f1170068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1019ffb700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1008066800 0x7f1008068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1188084900 con 0x7f118c16e660 2024-05-08T20:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11919bc700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1170066730 0x7f1170068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10140835e0 con 0x7f1024071e70 2024-05-08T20:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11827fc700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f117006e8d0 0x7f1170070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 --> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11700713a0 con 0x7f117006e8d0 2024-05-08T20:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1188084c70 con 0x7f118c16e660 2024-05-08T20:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd455d9b700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7fd43c0015e0 0x7fd43c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1019ffb700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f100806ea20 0x7f1008070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800c070 con 0x7faae8157b80 2024-05-08T20:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 --> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10080714f0 con 0x7f100806ea20 2024-05-08T20:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1014085c00 con 0x7f1024071e70 2024-05-08T20:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1029749700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1008066800 0x7f1008068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad8013610 con 0x7faae8157b80 2024-05-08T20:56:47.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e37fe700 1 --2- 172.21.15.107:0/668128880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e416da50 0x7f20e416de90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20e4071230 tx=0x7f20dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec80b7983b65519 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8013980 con 0x7faae8157b80 2024-05-08T20:56:47.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e2ffd700 1 -- 172.21.15.107:0/668128880 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00bdd0 con 0x7f20e416da50 2024-05-08T20:56:47.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e2ffd700 1 -- 172.21.15.107:0/668128880 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc0104d0 con 0x7f20e416da50 2024-05-08T20:56:47.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20e2ffd700 1 -- 172.21.15.107:0/668128880 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc010860 con 0x7f20e416da50 2024-05-08T20:56:47.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fd455d9b700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7fd43c0015e0 0x7fd43c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 -- 172.21.15.107:0/668128880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e416da50 msgr2=0x7f20e416de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f20ea910700 1 --2- 172.21.15.107:0/668128880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e416da50 0x7f20e416de90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20e4071230 tx=0x7f20dc00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1029f4a700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f100806ea20 0x7f1008070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f11911bb700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f117006e8d0 0x7f1170070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508004220 con 0x7f9518071e70 2024-05-08T20:56:47.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508004380 con 0x7f9518071e70 2024-05-08T20:56:47.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95080036c0 con 0x7f9518071e70 2024-05-08T20:56:47.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9518159060 con 0x7f9518071e70 2024-05-08T20:56:47.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9518159620 con 0x7f9518071e70 2024-05-08T20:56:47.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa234070110 0x7fa2341634f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234071e70 0x7fa2341ff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2340b3c20 0x7fa234152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341ffc40 con 0x7fa234071e70 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa234152730 con 0x7fa234070110 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa238960700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa234163bf0 con 0x7fa2340b3c20 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa2337fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa234070110 0x7fa2341634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa233fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2340b3c20 0x7fa234152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa233fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2340b3c20 0x7fa234152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53758/0 (socket says 172.21.15.107:53758) 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7fa233fff700 1 -- 172.21.15.107:0/1676125655 learned_addr learned my addr 172.21.15.107:0/1676125655 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f99f694b700 1 Processor -- start 2024-05-08T20:56:47.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.360+0000 7f1029749700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1008066800 0x7f1008068cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1020009a50 tx=0x7f1020009510 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae80cdc30 con 0x7faae8157b80 2024-05-08T20:56:47.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f1029f4a700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f100806ea20 0x7f1008070e40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae80ce1f0 con 0x7faae8157b80 2024-05-08T20:56:47.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa233fff700 1 -- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa234070110 msgr2=0x7fa2341634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa233fff700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa234070110 0x7fa2341634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa233fff700 1 -- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234071e70 msgr2=0x7fa2341ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f99f694b700 1 -- start start 2024-05-08T20:56:47.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f11911bb700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f117006e8d0 0x7f1170070cf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f11919bc700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1170066730 0x7f1170068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1184000f80 tx=0x7f1184010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== osd.2 v2:172.21.15.107:6816/26127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd43c006bf0 con 0x7fd43c0015e0 2024-05-08T20:56:47.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95180b2730 con 0x7f9518071e70 2024-05-08T20:56:47.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faae80acdb0 con 0x7faae8157b80 2024-05-08T20:56:47.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== osd.0 v2:172.21.15.107:6824/26126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f10080714f0 con 0x7f100806ea20 2024-05-08T20:56:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 -- 172.21.15.107:0/668128880 shutdown_connections 2024-05-08T20:56:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 --2- 172.21.15.107:0/668128880 >> v2:172.21.15.107:3300/0 conn(0x7f20e406d670 0x7f20e406db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 --2- 172.21.15.107:0/668128880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e416da50 0x7f20e416de90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 --2- 172.21.15.107:0/668128880 >> v2:172.21.15.195:3300/0 conn(0x7f20e41678d0 0x7f20e416af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 -- 172.21.15.107:0/668128880 >> 172.21.15.107:0/668128880 conn(0x7f20e40b0cd0 msgr2=0x7f20e40b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa232ffd700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234071e70 0x7fa2341ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa233fff700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa234071e70 0x7fa2341ff700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa233fff700 1 -- 172.21.15.107:0/1676125655 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c009b30 con 0x7fa2340b3c20 2024-05-08T20:56:47.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f99f694b700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f99f015e430 0x7f99f00b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa233fff700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2340b3c20 0x7fa234152950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b730 tx=0x7fa22c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f99f5949700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f99f0140130 0x7f99f00b1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50066/0 (socket says 172.21.15.107:50066) 2024-05-08T20:56:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f99f5949700 1 -- 172.21.15.107:0/1338255805 learned_addr learned my addr 172.21.15.107:0/1338255805 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:47.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f99f5148700 1 --2- 172.21.15.107:0/1338255805 >> v2:172.21.15.195:3300/0 conn(0x7f99f015e430 0x7f99f00b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faad8013ae0 con 0x7faae8157b80 2024-05-08T20:56:47.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9508003820 con 0x7f9518071e70 2024-05-08T20:56:47.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 -- 172.21.15.107:0/668128880 shutdown_connections 2024-05-08T20:56:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c004440 con 0x7fa2340b3c20 2024-05-08T20:56:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0045c0 con 0x7fa2340b3c20 2024-05-08T20:56:47.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae57fa700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7faacc0667b0 0x7faacc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faad80843e0 con 0x7faae8157b80 2024-05-08T20:56:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae57fa700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7faacc06e9d0 0x7faacc070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 --> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faacc0714a0 con 0x7faacc06e9d0 2024-05-08T20:56:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faad8084750 con 0x7faae8157b80 2024-05-08T20:56:47.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f94fffff700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9504066780 0x7f9504068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9508084190 con 0x7f9518071e70 2024-05-08T20:56:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7faae7fff700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7faacc06e9d0 0x7faacc070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f94fffff700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f950406e9a0 0x7f9504070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 --> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9504071470 con 0x7f950406e9a0 2024-05-08T20:56:47.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f20ea910700 1 -- 172.21.15.107:0/668128880 wait complete. 2024-05-08T20:56:47.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95080845e0 con 0x7f9518071e70 2024-05-08T20:56:47.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f9516ffd700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9504066780 0x7f9504068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f9517fff700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f950406e9a0 0x7f9504070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c004970 con 0x7fa2340b3c20 2024-05-08T20:56:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7faae7fff700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7faacc06e9d0 0x7faacc070df0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f9517fff700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f950406e9a0 0x7f9504070dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f9516ffd700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9504066780 0x7f9504068c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95181fa3f0 tx=0x7f9510009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.364+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== osd.4 v2:172.21.15.195:6808/26319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f11700713a0 con 0x7f117006e8d0 2024-05-08T20:56:47.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa234163ed0 con 0x7fa2340b3c20 2024-05-08T20:56:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7faaece3e700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7faacc0667b0 0x7faacc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa234164490 con 0x7fa2340b3c20 2024-05-08T20:56:47.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7faaece3e700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7faacc0667b0 0x7faacc068c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faadc009150 tx=0x7faadc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 Processor -- start 2024-05-08T20:56:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 -- start start 2024-05-08T20:56:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== osd.5 v2:172.21.15.195:6800/26317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9504071470 con 0x7f950406e9a0 2024-05-08T20:56:47.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== osd.7 v2:172.21.15.195:6824/26320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7faacc0714a0 con 0x7faacc06e9d0 2024-05-08T20:56:47.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa22c019070 con 0x7fa2340b3c20 2024-05-08T20:56:47.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7fa21bfff700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa220066780 0x7fa220068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa22c085020 con 0x7fa2340b3c20 2024-05-08T20:56:47.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7fa2337fe700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa220066780 0x7fa220068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7fa2337fe700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa220066780 0x7fa220068c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa224009980 tx=0x7fa2240090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f00b4800 con 0x7f99f0142880 2024-05-08T20:56:47.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f0140510 con 0x7f99f0140130 2024-05-08T20:56:47.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f00b3ed0 con 0x7f99f015e430 2024-05-08T20:56:47.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f5148700 1 -- 172.21.15.107:0/1338255805 >> v1:172.21.15.195:6789/0 conn(0x7f99f0140130 legacy=0x7f99f00b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f5148700 1 -- 172.21.15.107:0/1338255805 >> v1:172.21.15.107:6789/0 conn(0x7f99f0142880 legacy=0x7f99f00ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f5148700 1 -- 172.21.15.107:0/1338255805 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f00b41b0 con 0x7f99f015e430 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f5148700 1 --2- 172.21.15.107:0/1338255805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e430 0x7f99f00b4c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009d90 tx=0x7f99e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=376a360a5e5bbaad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f4947700 1 -- 172.21.15.107:0/1338255805 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e800bdd0 con 0x7f99f015e430 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f4947700 1 -- 172.21.15.107:0/1338255805 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e80148d0 con 0x7f99f015e430 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f99f4947700 1 -- 172.21.15.107:0/1338255805 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8014c80 con 0x7f99f015e430 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e430 msgr2=0x7f99f00b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 --2- 172.21.15.107:0/1338255805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e430 0x7f99f00b4c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009d90 tx=0x7f99e800b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 shutdown_connections 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 --2- 172.21.15.107:0/1338255805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f015e430 0x7f99f00b4c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 >> 172.21.15.107:0/1338255805 conn(0x7f99f006c330 msgr2=0x7f99f006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 shutdown_connections 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 -- 172.21.15.107:0/1338255805 wait complete. 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 Processor -- start 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f99f694b700 1 -- start start 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f0140130 0x7f99f013a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f0142880 0x7f99f0137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e406d670 0x7f20e42034c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e41678d0 0x7f20e40aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e416da50 0x7f20e40cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e40aa320 con 0x7f20e416da50 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e42072b0 con 0x7f20e406d670 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20ea910700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4204780 con 0x7f20e41678d0 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e406d670 0x7f20e42034c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e406d670 0x7f20e42034c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38558/0 (socket says 172.21.15.107:38558) 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 -- 172.21.15.107:0/2328201849 learned_addr learned my addr 172.21.15.107:0/2328201849 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 -- 172.21.15.107:0/2328201849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e41678d0 msgr2=0x7f20e40aa920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f20e41678d0 0x7f20e40aa920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 -- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e416da50 msgr2=0x7f20e40cd750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20e416da50 0x7f20e40cd750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 -- 172.21.15.107:0/2328201849 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009a70 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.368+0000 7f20e3fff700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e406d670 0x7f20e42034c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f20d400b550 tx=0x7f20d400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011830 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e4203e50 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e4203a00 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4011990 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4011d00 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20d401a400 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e0ff9700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f20d0066760 0x7f20d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e37fe700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f20d0066760 0x7f20d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.372+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20d4084220 con 0x7f20e406d670 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.376+0000 7f20e37fe700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f20d0066760 0x7f20d0068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20e40aebf0 tx=0x7f20dc014000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f20ea910700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f20c40015e0 0x7f20c4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99f015e430 0x7f99f00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f0142880 0x7f99f0137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 --> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20c4006bf0 con 0x7f20c40015e0 2024-05-08T20:56:47.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0140ba0 con 0x7f99f015e430 2024-05-08T20:56:47.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f614a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99f015e430 0x7f99f00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f0142880 0x7f99f0137e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38560/0 (socket says 172.21.15.107:38560) 2024-05-08T20:56:47.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 -- 172.21.15.107:0/917321923 learned_addr learned my addr 172.21.15.107:0/917321923 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f20e8ead700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f20c40015e0 0x7f20c4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f013b1d0 con 0x7f99f0142880 2024-05-08T20:56:47.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f0140800 con 0x7f99f0140130 2024-05-08T20:56:47.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7fa238960700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7fa2341652a0 0x7fa2340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 --> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2340b2730 con 0x7fa2341652a0 2024-05-08T20:56:47.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5949700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f0140130 0x7f99f013a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7fa232ffd700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7fa2341652a0 0x7fa2340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f20e8ead700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f20c40015e0 0x7f20c4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 -- 172.21.15.107:0/917321923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f0140130 msgr2=0x7f99f013a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f99f0140130 0x7f99f013a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 -- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99f015e430 msgr2=0x7f99f00705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f99f015e430 0x7f99f00705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8009a70 con 0x7f99f0142880 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f5148700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f0142880 0x7f99f0137e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99e801f040 tx=0x7f99e8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8003d40 con 0x7f99f0142880 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f013ac10 con 0x7f99f0142880 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f013a890 con 0x7f99f0142880 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e80142e0 con 0x7f99f0142880 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e8003ea0 con 0x7f99f0142880 2024-05-08T20:56:47.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== osd.1 v2:172.21.15.107:6800/26124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f20c4006bf0 con 0x7f20c40015e0 2024-05-08T20:56:47.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.380+0000 7fa232ffd700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7fa2341652a0 0x7fa2340cc680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.384+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 --> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1168002d60 con 0x7f117006e8d0 2024-05-08T20:56:47.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.384+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== osd.6 v2:172.21.15.195:6816/26318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa228009500 con 0x7fa2341652a0 2024-05-08T20:56:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.384+0000 7f11827fc700 1 -- 172.21.15.107:0/2283340179 <== osd.4 v2:172.21.15.195:6808/26319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1168002d60 con 0x7f117006e8d0 2024-05-08T20:56:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.384+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99e8014030 con 0x7f99f0142880 2024-05-08T20:56:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.384+0000 7f99e67fc700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f99dc066860 0x7f99dc068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.384+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99e80856d0 con 0x7f99f0142880 2024-05-08T20:56:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99f694b700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7f99d80015e0 0x7f99d8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99f5949700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f99dc066860 0x7f99dc068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99d8006bf0 con 0x7f99d80015e0 2024-05-08T20:56:47.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99f614a700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7f99d80015e0 0x7f99d8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f117006e8d0 msgr2=0x7f1170070cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f117006e8d0 0x7f1170070cf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99f614a700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7f99d80015e0 0x7f99d8003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1170066730 msgr2=0x7f1170068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1170066730 0x7f1170068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1184000f80 tx=0x7f1184010000 comp rx=0 tx=0).stop 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c16e660 msgr2=0x7f118c15a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 --2- 172.21.15.107:0/2283340179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f118c16e660 0x7f118c15a300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f118800c7c0 tx=0x7f118800cb80 comp rx=0 tx=0).stop 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f11921bd700 1 -- 172.21.15.107:0/2283340179 reap_dead start 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 shutdown_connections 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 >> 172.21.15.107:0/2283340179 conn(0x7f118c0b0cd0 msgr2=0x7f118c089900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 shutdown_connections 2024-05-08T20:56:47.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f116ffff700 1 -- 172.21.15.107:0/2283340179 wait complete. 2024-05-08T20:56:47.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99f5949700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f99dc066860 0x7f99dc068d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99e0005930 tx=0x7f99e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.388+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== osd.3 v2:172.21.15.107:6808/26125 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f99d8006bf0 con 0x7f99d80015e0 2024-05-08T20:56:47.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.392+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 --> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd43c005ca0 con 0x7fd43c0015e0 2024-05-08T20:56:47.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.392+0000 7fd446ffd700 1 -- 172.21.15.107:0/1871106831 <== osd.2 v2:172.21.15.107:6816/26127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd43c005ca0 con 0x7fd43c0015e0 2024-05-08T20:56:47.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 --> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10240b2730 con 0x7f100806ea20 2024-05-08T20:56:47.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7fd43c0015e0 msgr2=0x7fd43c003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7fd43c0015e0 0x7fd43c003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7f1019ffb700 1 -- 172.21.15.107:0/738800709 <== osd.0 v2:172.21.15.107:6824/26126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f101c0092e0 con 0x7f100806ea20 2024-05-08T20:56:47.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd438066730 msgr2=0x7fd438068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd438066730 0x7fd438068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd4480097d0 tx=0x7fd448008000 comp rx=0 tx=0).stop 2024-05-08T20:56:47.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458160c80 msgr2=0x7fd458143f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 --2- 172.21.15.107:0/1871106831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd458160c80 0x7fd458143f10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd44c00c450 tx=0x7fd44c00c760 comp rx=0 tx=0).stop 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd456d9d700 1 -- 172.21.15.107:0/1871106831 reap_dead start 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 shutdown_connections 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 >> 172.21.15.107:0/1871106831 conn(0x7fd4580aebd0 msgr2=0x7fd4580b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 shutdown_connections 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.396+0000 7fd45759e700 1 -- 172.21.15.107:0/1871106831 wait complete. 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 --> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95180b2450 con 0x7f950406e9a0 2024-05-08T20:56:47.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 --> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faae8149400 con 0x7faacc06e9d0 2024-05-08T20:56:47.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f100806ea20 msgr2=0x7f1008070e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f100806ea20 0x7f1008070e40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1008066800 msgr2=0x7f1008068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1008066800 0x7f1008068cc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1020009a50 tx=0x7f1020009510 comp rx=0 tx=0).stop 2024-05-08T20:56:47.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024071e70 msgr2=0x7f102414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 --2- 172.21.15.107:0/738800709 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1024071e70 0x7f102414ce10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f101400c500 tx=0x7f101400c8c0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f1029f4a700 1 -- 172.21.15.107:0/738800709 reap_dead start 2024-05-08T20:56:47.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 shutdown_connections 2024-05-08T20:56:47.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 >> 172.21.15.107:0/738800709 conn(0x7f102406c330 msgr2=0x7f1024071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7faae57fa700 1 -- 172.21.15.107:0/3270634386 <== osd.7 v2:172.21.15.195:6824/26320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faae000a7a0 con 0x7faacc06e9d0 2024-05-08T20:56:47.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.400+0000 7f94fffff700 1 -- 172.21.15.107:0/3742514076 <== osd.5 v2:172.21.15.195:6800/26317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f950c0094c0 con 0x7f950406e9a0 2024-05-08T20:56:47.461 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:47.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T20:56:47.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.404+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 shutdown_connections 2024-05-08T20:56:47.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.404+0000 7f100f7fe700 1 -- 172.21.15.107:0/738800709 wait complete. 2024-05-08T20:56:47.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7faacc06e9d0 msgr2=0x7faacc070df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7faacc06e9d0 0x7faacc070df0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f950406e9a0 msgr2=0x7f9504070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f950406e9a0 0x7f9504070dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7faacc0667b0 msgr2=0x7faacc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7faacc0667b0 0x7faacc068c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faadc009150 tx=0x7faadc008030 comp rx=0 tx=0).stop 2024-05-08T20:56:47.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 msgr2=0x7faae806b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 --2- 172.21.15.107:0/3270634386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae8157b80 0x7faae806b870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faad800e7e0 tx=0x7faad800eaf0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9504066780 msgr2=0x7f9504068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9504066780 0x7f9504068c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95181fa3f0 tx=0x7f9510009000 comp rx=0 tx=0).stop 2024-05-08T20:56:47.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 msgr2=0x7f9518155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 --2- 172.21.15.107:0/3742514076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9518071e70 0x7f9518155210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f950800c7f0 tx=0x7f950800cb00 comp rx=0 tx=0).stop 2024-05-08T20:56:47.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f9517fff700 1 -- 172.21.15.107:0/3742514076 reap_dead start 2024-05-08T20:56:47.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 shutdown_connections 2024-05-08T20:56:47.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaed63f700 1 -- 172.21.15.107:0/3270634386 reap_dead start 2024-05-08T20:56:47.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 >> 172.21.15.107:0/3742514076 conn(0x7f951806c330 msgr2=0x7f95180ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 shutdown_connections 2024-05-08T20:56:47.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f951ce0f700 1 -- 172.21.15.107:0/3742514076 wait complete. 2024-05-08T20:56:47.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 shutdown_connections 2024-05-08T20:56:47.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 >> 172.21.15.107:0/3270634386 conn(0x7faae80cfe10 msgr2=0x7faae80ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 shutdown_connections 2024-05-08T20:56:47.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7faaede40700 1 -- 172.21.15.107:0/3270634386 wait complete. 2024-05-08T20:56:47.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 --> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20c4005cd0 con 0x7f20c40015e0 2024-05-08T20:56:47.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 --> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2340cb710 con 0x7fa2341652a0 2024-05-08T20:56:47.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.408+0000 7f20e0ff9700 1 -- 172.21.15.107:0/2328201849 <== osd.1 v2:172.21.15.107:6800/26124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20c4005cd0 con 0x7f20c40015e0 2024-05-08T20:56:47.468 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:47.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T20:56:47.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa21bfff700 1 -- 172.21.15.107:0/1676125655 <== osd.6 v2:172.21.15.195:6816/26318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa228009900 con 0x7fa2341652a0 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f20c40015e0 msgr2=0x7f20c4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f20c40015e0 0x7f20c4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f20d0066760 msgr2=0x7f20d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f20d0066760 0x7f20d0068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20e40aebf0 tx=0x7f20dc014000 comp rx=0 tx=0).stop 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e406d670 msgr2=0x7f20e42034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 --2- 172.21.15.107:0/2328201849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f20e406d670 0x7f20e42034c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f20d400b550 tx=0x7f20d400b910 comp rx=0 tx=0).stop 2024-05-08T20:56:47.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20e8ead700 1 -- 172.21.15.107:0/2328201849 reap_dead start 2024-05-08T20:56:47.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7fa2341652a0 msgr2=0x7fa2340cc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7fa2341652a0 0x7fa2340cc680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 shutdown_connections 2024-05-08T20:56:47.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 >> 172.21.15.107:0/2328201849 conn(0x7f20e40b0cd0 msgr2=0x7f20e416b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 shutdown_connections 2024-05-08T20:56:47.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f20ea910700 1 -- 172.21.15.107:0/2328201849 wait complete. 2024-05-08T20:56:47.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa220066780 msgr2=0x7fa220068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa220066780 0x7fa220068c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa224009980 tx=0x7fa2240090e0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2340b3c20 msgr2=0x7fa234152950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 --2- 172.21.15.107:0/1676125655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2340b3c20 0x7fa234152950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00b730 tx=0x7fa22c004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa233fff700 1 -- 172.21.15.107:0/1676125655 reap_dead start 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 shutdown_connections 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 >> 172.21.15.107:0/1676125655 conn(0x7fa23406c330 msgr2=0x7fa23406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 shutdown_connections 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7fa238960700 1 -- 172.21.15.107:0/1676125655 wait complete. 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.412+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 --> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99d8005cd0 con 0x7f99d80015e0 2024-05-08T20:56:47.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.416+0000 7f99e67fc700 1 -- 172.21.15.107:0/917321923 <== osd.3 v2:172.21.15.107:6808/26125 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99d8005cd0 con 0x7f99d80015e0 2024-05-08T20:56:47.474 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:47.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7f99d80015e0 msgr2=0x7f99d8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7f99d80015e0 0x7f99d8003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f99dc066860 msgr2=0x7f99dc068d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f99dc066860 0x7f99dc068d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99e0005930 tx=0x7f99e0009040 comp rx=0 tx=0).stop 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f0142880 msgr2=0x7f99f0137e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 --2- 172.21.15.107:0/917321923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99f0142880 0x7f99f0137e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f99e801f040 tx=0x7f99e8004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f614a700 1 -- 172.21.15.107:0/917321923 reap_dead start 2024-05-08T20:56:47.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 shutdown_connections 2024-05-08T20:56:47.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 >> 172.21.15.107:0/917321923 conn(0x7f99f006c330 msgr2=0x7f99f015c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 shutdown_connections 2024-05-08T20:56:47.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.420+0000 7f99f694b700 1 -- 172.21.15.107:0/917321923 wait complete. 2024-05-08T20:56:47.477 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:47.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T20:56:47.478 INFO:teuthology.orchestra.run.smithi107.stdout:55834574855 2024-05-08T20:56:47.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T20:56:47.479 INFO:teuthology.orchestra.run.smithi107.stdout:55834574855 2024-05-08T20:56:47.480 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T20:56:47.481 INFO:teuthology.orchestra.run.smithi107.stdout:55834574855 2024-05-08T20:56:47.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T20:56:47.482 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:47.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T20:56:47.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1e1228700 1 Processor -- start 2024-05-08T20:56:47.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bf59e700 1 Processor -- start 2024-05-08T20:56:47.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1e1228700 1 -- start start 2024-05-08T20:56:47.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bf59e700 1 -- start start 2024-05-08T20:56:47.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7efe6230a700 1 Processor -- start 2024-05-08T20:56:47.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bf59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f56c00d1140 0x7f56c00cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fee20911700 1 Processor -- start 2024-05-08T20:56:47.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1e1228700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb1dc0b1f60 0x7fb1dc06e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1e1228700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc0b2740 con 0x7fb1dc0ac8e0 2024-05-08T20:56:47.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1e1228700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc06d990 con 0x7fb1dc160c80 2024-05-08T20:56:47.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1e1228700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc146d60 con 0x7fb1dc0b1f60 2024-05-08T20:56:47.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f1783fff700 1 Processor -- start 2024-05-08T20:56:47.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7efe6230a700 1 -- start start 2024-05-08T20:56:47.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bf59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c015eb40 con 0x7f56c00cef90 2024-05-08T20:56:47.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bf59e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c00ce5c0 con 0x7f56c015e760 2024-05-08T20:56:47.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bf59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00d1e90 con 0x7f56c00d1140 2024-05-08T20:56:47.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f96826c6700 1 Processor -- start 2024-05-08T20:56:47.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bed9d700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f56c00cef90 0x7f56c00cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60926/0 (socket says 172.21.15.107:60926) 2024-05-08T20:56:47.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bed9d700 1 -- 172.21.15.107:0/450053096 learned_addr learned my addr 172.21.15.107:0/450053096 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:47.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1db7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb1dc0b1f60 0x7fb1dc06e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1db7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb1dc0b1f60 0x7fb1dc06e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50624/0 (socket says 172.21.15.107:50624) 2024-05-08T20:56:47.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7fb1db7fe700 1 -- 172.21.15.107:0/1331164145 learned_addr learned my addr 172.21.15.107:0/1331164145 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f1783fff700 1 -- start start 2024-05-08T20:56:47.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f56bdd9b700 1 --2- 172.21.15.107:0/450053096 >> v2:172.21.15.195:3300/0 conn(0x7f56c00d1140 0x7f56c00cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.668+0000 7f96826c6700 1 -- start start 2024-05-08T20:56:47.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212467148 0 0) 0x7fb1dc0b2740 con 0x7fb1dc0ac8e0 2024-05-08T20:56:47.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c40035d0 con 0x7fb1dc0ac8e0 2024-05-08T20:56:47.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bdd9b700 1 -- 172.21.15.107:0/450053096 >> v1:172.21.15.195:6789/0 conn(0x7f56c015e760 legacy=0x7f56c00d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bdd9b700 1 -- 172.21.15.107:0/450053096 >> v1:172.21.15.107:6789/0 conn(0x7f56c00cef90 legacy=0x7f56c00cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bdd9b700 1 -- 172.21.15.107:0/450053096 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c00d2170 con 0x7f56c00d1140 2024-05-08T20:56:47.683 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 141953338 0 0) 0x7fb1c40035d0 con 0x7fb1dc0ac8e0 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc0b1f60 msgr2=0x7fb1dc06e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 --2- 172.21.15.107:0/1331164145 >> v2:172.21.15.107:3300/0 conn(0x7fb1dc0b1f60 0x7fb1dc06e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 >> v1:172.21.15.195:6789/0 conn(0x7fb1dc160c80 legacy=0x7fb1dc161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0b2460 con 0x7fb1dc0ac8e0 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7fb1d0001670 con 0x7fb1dc0ac8e0 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 >> v1:172.21.15.107:6789/0 conn(0x7fb1dc0ac8e0 legacy=0x7fb1dc0acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1c4003a20 0x7fb1c4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1c4004870 0x7fb1c4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1c400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc146d60 con 0x7fb1c4003a20 2024-05-08T20:56:47.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c400c220 con 0x7fb1c4005350 2024-05-08T20:56:47.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c400c3e0 con 0x7fb1c4004870 2024-05-08T20:56:47.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bdd9b700 1 --2- 172.21.15.107:0/450053096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 0x7f56c00cea50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009850 tx=0x7f56b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e459138796c9698 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe5c0cdc20 0x7efe5c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1c400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1db7fe700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1c4004870 0x7fb1c4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe5c0b1f60 0x7efe5c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c0b2d90 con 0x7efe5c0ce000 2024-05-08T20:56:47.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c150680 con 0x7efe5c0b1f60 2024-05-08T20:56:47.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c0b2910 con 0x7efe5c0cdc20 2024-05-08T20:56:47.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1783fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1784160c80 0x7f1784161060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f96826c6700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c159560 0x7f967c0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1783fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f17840ac8e0 0x7f17840acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1783fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17840b2740 con 0x7f17840b1f60 2024-05-08T20:56:47.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1783fff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178406d990 con 0x7f17840ac8e0 2024-05-08T20:56:47.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1783fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1784146d60 con 0x7f1784160c80 2024-05-08T20:56:47.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bd59a700 1 -- 172.21.15.107:0/450053096 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b4004230 con 0x7f56c00d1140 2024-05-08T20:56:47.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe5c0b1f60 0x7efe5c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe5c0b1f60 0x7efe5c0b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50630/0 (socket says 172.21.15.107:50630) 2024-05-08T20:56:47.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 -- 172.21.15.107:0/2613021906 learned_addr learned my addr 172.21.15.107:0/2613021906 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f96826c6700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f967c0b4b60 0x7f967c06dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61308700 1 --2- 172.21.15.107:0/2613021906 >> v2:172.21.15.195:3300/0 conn(0x7efe5c0cdc20 0x7efe5c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f96826c6700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f967c0b25c0 con 0x7f967c0cd310 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f96826c6700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f967c06d690 con 0x7f967c0b4b60 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f96826c6700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c0b34b0 con 0x7f967c159560 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f967c0b4b60 0x7f967c06dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f967c0b4b60 0x7f967c06dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38610/0 (socket says 172.21.15.107:38610) 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 -- 172.21.15.107:0/2997081258 learned_addr learned my addr 172.21.15.107:0/2997081258 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1dbfff700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1c4003a20 0x7fb1c4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 -- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1c4004870 msgr2=0x7fb1c4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1c4004870 0x7fb1c4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 -- 172.21.15.107:0/1331164145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1c4003a20 msgr2=0x7fb1c4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1c4003a20 0x7fb1c4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 -- 172.21.15.107:0/1331164145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40035d0 con 0x7fb1c4005350 2024-05-08T20:56:47.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17827fc700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f17840b1f60 0x7f178406e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60948/0 (socket says 172.21.15.107:60948) 2024-05-08T20:56:47.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17827fc700 1 -- 172.21.15.107:0/2485557591 learned_addr learned my addr 172.21.15.107:0/2485557591 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:47.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bd59a700 1 -- 172.21.15.107:0/450053096 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b4004390 con 0x7f56c00d1140 2024-05-08T20:56:47.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bd59a700 1 -- 172.21.15.107:0/450053096 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40036c0 con 0x7f56c00d1140 2024-05-08T20:56:47.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee20911700 1 -- start start 2024-05-08T20:56:47.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 -- 172.21.15.107:0/2613021906 >> v2:172.21.15.195:3300/0 conn(0x7efe5c0cdc20 msgr2=0x7efe5c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 --2- 172.21.15.107:0/2613021906 >> v2:172.21.15.195:3300/0 conn(0x7efe5c0cdc20 0x7efe5c06d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 -- 172.21.15.107:0/2613021906 >> v1:172.21.15.107:6789/0 conn(0x7efe5c0ce000 legacy=0x7efe5c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 -- 172.21.15.107:0/2613021906 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c0ce4b0 con 0x7efe5c0b1f60 2024-05-08T20:56:47.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 -- 172.21.15.107:0/1331164145 reap_dead start 2024-05-08T20:56:47.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17837fe700 1 --2- 172.21.15.107:0/2485557591 >> v2:172.21.15.195:3300/0 conn(0x7f17840ac8e0 0x7f17840acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1dbfff700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1c4003a20 0x7fb1c4003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:47.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe61b09700 1 --2- 172.21.15.107:0/2613021906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0b1f60 0x7efe5c0b23d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0b1b70 tx=0x7efe58009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee544b2586d5aff1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1e0a27700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1c400ba30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c160 tx=0x7fb1c40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb0dc8761fa69e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f96816c4700 1 --2- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c159560 0x7f967c0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1781ffb700 1 -- 172.21.15.107:0/2485557591 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745307507 0 0) 0x7f17840b2740 con 0x7f17840b1f60 2024-05-08T20:56:47.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1781ffb700 1 -- 172.21.15.107:0/2485557591 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f176c0035d0 con 0x7f17840b1f60 2024-05-08T20:56:47.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 -- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c159560 msgr2=0x7f967c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 --2- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c159560 0x7f967c0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 -- 172.21.15.107:0/2997081258 >> v1:172.21.15.195:6789/0 conn(0x7f967c0cd310 legacy=0x7f967c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 -- 172.21.15.107:0/2997081258 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c159940 con 0x7f967c0b4b60 2024-05-08T20:56:47.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe53fff700 1 -- 172.21.15.107:0/2613021906 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800b8a0 con 0x7efe5c0b1f60 2024-05-08T20:56:47.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe53fff700 1 -- 172.21.15.107:0/2613021906 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5800ba00 con 0x7efe5c0b1f60 2024-05-08T20:56:47.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe53fff700 1 -- 172.21.15.107:0/2613021906 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800bd90 con 0x7efe5c0b1f60 2024-05-08T20:56:47.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 -- 172.21.15.107:0/450053096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 msgr2=0x7f56c00cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 --2- 172.21.15.107:0/450053096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 0x7f56c00cea50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009850 tx=0x7f56b4009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:47.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7ff39b337700 1 Processor -- start 2024-05-08T20:56:47.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 -- 172.21.15.107:0/450053096 shutdown_connections 2024-05-08T20:56:47.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 --2- 172.21.15.107:0/450053096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 0x7f56c00cea50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 -- 172.21.15.107:0/450053096 >> 172.21.15.107:0/450053096 conn(0x7f56c009c3b0 msgr2=0x7f56c00d3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7ff39b337700 1 -- start start 2024-05-08T20:56:47.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f9681ec5700 1 --2- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c0b4b60 0x7f967c06dab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9674009e50 tx=0x7f967400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9845c10535f203d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 -- 172.21.15.107:0/450053096 shutdown_connections 2024-05-08T20:56:47.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f56bf59e700 1 -- 172.21.15.107:0/450053096 wait complete. 2024-05-08T20:56:47.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee20911700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fee1c06d820 0x7fee1c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee20911700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fee1c0ce160 0x7fee1c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1782ffd700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1784160c80 0x7f1784161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0016070 con 0x7fb1c4005350 2024-05-08T20:56:47.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d000cb00 con 0x7fb1c4005350 2024-05-08T20:56:47.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fb1daffd700 1 -- 172.21.15.107:0/1331164145 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0007b50 con 0x7fb1c4005350 2024-05-08T20:56:47.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17837fe700 1 -- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1784160c80 msgr2=0x7f1784161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17837fe700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1784160c80 0x7f1784161060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17837fe700 1 -- 172.21.15.107:0/2485557591 >> v1:172.21.15.107:6789/0 conn(0x7f17840b1f60 legacy=0x7f178406e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f17837fe700 1 -- 172.21.15.107:0/2485557591 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17841615a0 con 0x7f17840ac8e0 2024-05-08T20:56:47.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1782ffd700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1784160c80 0x7f1784161060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee20911700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0b2d90 con 0x7fee1c072120 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee20911700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c150680 con 0x7fee1c06d820 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee20911700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c06dcd0 con 0x7fee1c0ce160 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fee1c06d820 0x7fee1c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fee1c06d820 0x7fee1c0cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50632/0 (socket says 172.21.15.107:50632) 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1b59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fee1c0ce160 0x7fee1c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 -- 172.21.15.107:0/2929965896 learned_addr learned my addr 172.21.15.107:0/2929965896 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 -- 172.21.15.107:0/2929965896 >> v2:172.21.15.195:3300/0 conn(0x7fee1c0ce160 msgr2=0x7fee1c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 --2- 172.21.15.107:0/2929965896 >> v2:172.21.15.195:3300/0 conn(0x7fee1c0ce160 0x7fee1c0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 -- 172.21.15.107:0/2929965896 >> v1:172.21.15.195:6789/0 conn(0x7fee1c072120 legacy=0x7fee1c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7fee1a59c700 1 -- 172.21.15.107:0/2929965896 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c06d390 con 0x7fee1c06d820 2024-05-08T20:56:47.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee1a59c700 1 --2- 172.21.15.107:0/2929965896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c06d820 0x7fee1c0cdc20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee1c072500 tx=0x7fee10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b8e1781ad3e54b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 Processor -- start 2024-05-08T20:56:47.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fb1e1228700 1 -- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 msgr2=0x7fb1c400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fb1e1228700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1c400ba30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c160 tx=0x7fb1c40058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7f1781ffb700 1 -- 172.21.15.107:0/2485557591 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 928613842 0 0) 0x7f176c0035d0 con 0x7f17840b1f60 2024-05-08T20:56:47.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f966ffff700 1 -- 172.21.15.107:0/2997081258 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400e070 con 0x7f967c0b4b60 2024-05-08T20:56:47.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f17837fe700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 0x7f17840acd70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1778009850 tx=0x7f1778009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79bbfef1e3cf4d11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f966ffff700 1 -- 172.21.15.107:0/2997081258 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400b9c0 con 0x7f967c0b4b60 2024-05-08T20:56:47.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f966ffff700 1 -- 172.21.15.107:0/2997081258 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400bd70 con 0x7f967c0b4b60 2024-05-08T20:56:47.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39b337700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff3940b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39b337700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff39406b370 0x7ff39406b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fb1e1228700 1 -- 172.21.15.107:0/1331164145 shutdown_connections 2024-05-08T20:56:47.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fb1e1228700 1 --2- 172.21.15.107:0/1331164145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1c400ba30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fb1e1228700 1 -- 172.21.15.107:0/1331164145 >> 172.21.15.107:0/1331164145 conn(0x7fb1dc0aebd0 msgr2=0x7fb1dc0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 -- start start 2024-05-08T20:56:47.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39b337700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940b2610 con 0x7ff3940b3e80 2024-05-08T20:56:47.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39b337700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39415a2d0 con 0x7ff39406b370 2024-05-08T20:56:47.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39b337700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39406bd40 con 0x7ff394159ef0 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 -- 172.21.15.107:0/2613021906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0b1f60 msgr2=0x7efe5c0b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 --2- 172.21.15.107:0/2613021906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0b1f60 0x7efe5c0b23d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0b1b70 tx=0x7efe58009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 -- 172.21.15.107:0/2613021906 shutdown_connections 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 --2- 172.21.15.107:0/2613021906 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0b1f60 0x7efe5c0b23d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 --2- 172.21.15.107:0/2613021906 >> v2:172.21.15.195:3300/0 conn(0x7efe5c0cdc20 0x7efe5c06d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.672+0000 7efe6230a700 1 -- 172.21.15.107:0/2613021906 >> 172.21.15.107:0/2613021906 conn(0x7efe5c0aebd0 msgr2=0x7efe5c0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 -- 172.21.15.107:0/2613021906 shutdown_connections 2024-05-08T20:56:47.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 -- 172.21.15.107:0/2613021906 wait complete. 2024-05-08T20:56:47.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1781ffb700 1 -- 172.21.15.107:0/2485557591 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774001670 con 0x7f17840ac8e0 2024-05-08T20:56:47.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff399b34700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff3940b3e80 0x7ff39406da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60950/0 (socket says 172.21.15.107:60950) 2024-05-08T20:56:47.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff399b34700 1 -- 172.21.15.107:0/3171388872 learned_addr learned my addr 172.21.15.107:0/3171388872 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:47.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1781ffb700 1 -- 172.21.15.107:0/2485557591 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778004030 con 0x7f17840ac8e0 2024-05-08T20:56:47.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1781ffb700 1 -- 172.21.15.107:0/2485557591 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17780043e0 con 0x7f17840ac8e0 2024-05-08T20:56:47.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39ab36700 1 --2- 172.21.15.107:0/3171388872 >> v2:172.21.15.195:3300/0 conn(0x7ff39406b370 0x7ff39406b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39ab36700 1 -- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 msgr2=0x7ff3940b3060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:47.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 Processor -- start 2024-05-08T20:56:47.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 -- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c0b4b60 msgr2=0x7f967c06dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 --2- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c0b4b60 0x7f967c06dab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9674009e50 tx=0x7f967400b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff2901478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff290165240 0x7ff290162360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff2901628a0 0x7ff290144d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39ab36700 1 --2- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff3940b3060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39ab36700 1 -- 172.21.15.107:0/3171388872 >> v1:172.21.15.107:6789/0 conn(0x7ff3940b3e80 legacy=0x7ff39406da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39ab36700 1 -- 172.21.15.107:0/3171388872 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39406e2e0 con 0x7ff39406b370 2024-05-08T20:56:47.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 -- 172.21.15.107:0/2997081258 shutdown_connections 2024-05-08T20:56:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 --2- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c0b4b60 0x7f967c06dab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 --2- 172.21.15.107:0/2997081258 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c159560 0x7f967c0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 -- 172.21.15.107:0/2997081258 >> 172.21.15.107:0/2997081258 conn(0x7f967c0aebd0 msgr2=0x7f967c0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff290161c50 con 0x7ff290165240 2024-05-08T20:56:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff290166210 con 0x7ff2901628a0 2024-05-08T20:56:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff2957a1700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290144ac0 con 0x7ff2900cb3b0 2024-05-08T20:56:47.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 -- 172.21.15.107:0/2997081258 shutdown_connections 2024-05-08T20:56:47.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1783fff700 1 -- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 msgr2=0x7f17840acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1783fff700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 0x7f17840acd70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1778009850 tx=0x7f1778009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:47.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 -- 172.21.15.107:0/2997081258 wait complete. 2024-05-08T20:56:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee19d9b700 1 -- 172.21.15.107:0/2929965896 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10011830 con 0x7fee1c06d820 2024-05-08T20:56:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee19d9b700 1 -- 172.21.15.107:0/2929965896 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee10011990 con 0x7fee1c06d820 2024-05-08T20:56:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee19d9b700 1 -- 172.21.15.107:0/2929965896 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10011d20 con 0x7fee1c06d820 2024-05-08T20:56:47.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28effd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff2901478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28f7fe700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff2901628a0 0x7ff290144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28f7fe700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ff2901628a0 0x7ff290144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38644/0 (socket says 172.21.15.107:38644) 2024-05-08T20:56:47.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28effd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff2901478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53834/0 (socket says 172.21.15.107:53834) 2024-05-08T20:56:47.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28f7fe700 1 -- 172.21.15.107:0/2625005678 learned_addr learned my addr 172.21.15.107:0/2625005678 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff290165240 0x7ff290162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fb1e1228700 1 -- 172.21.15.107:0/1331164145 shutdown_connections 2024-05-08T20:56:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 -- 172.21.15.107:0/2625005678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 msgr2=0x7ff2901478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/2625005678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff2901478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 -- 172.21.15.107:0/2625005678 >> v2:172.21.15.195:3300/0 conn(0x7ff2901628a0 msgr2=0x7ff290144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/2625005678 >> v2:172.21.15.195:3300/0 conn(0x7ff2901628a0 0x7ff290144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 -- 172.21.15.107:0/2625005678 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2901656a0 con 0x7ff290165240 2024-05-08T20:56:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/2625005678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff290162360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff29015f820 tx=0x7ff28800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f478b2aa6e6a3c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 -- 172.21.15.107:0/2929965896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c06d820 msgr2=0x7fee1c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 --2- 172.21.15.107:0/2929965896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c06d820 0x7fee1c0cdc20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fee1c072500 tx=0x7fee10009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff39ab36700 1 --2- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39406b800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e36159548addcb4c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28dffb700 1 -- 172.21.15.107:0/2625005678 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800e070 con 0x7ff290165240 2024-05-08T20:56:47.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 -- 172.21.15.107:0/2929965896 shutdown_connections 2024-05-08T20:56:47.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 --2- 172.21.15.107:0/2929965896 >> v2:172.21.15.195:3300/0 conn(0x7fee1c0ce160 0x7fee1c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 --2- 172.21.15.107:0/2929965896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c06d820 0x7fee1c0cdc20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 -- 172.21.15.107:0/2929965896 >> 172.21.15.107:0/2929965896 conn(0x7fee1c0aebd0 msgr2=0x7fee1c0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28dffb700 1 -- 172.21.15.107:0/2625005678 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800bae0 con 0x7ff290165240 2024-05-08T20:56:47.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff28dffb700 1 -- 172.21.15.107:0/2625005678 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800be90 con 0x7ff290165240 2024-05-08T20:56:47.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 Processor -- start 2024-05-08T20:56:47.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 -- start start 2024-05-08T20:56:47.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 0x7f56c01f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 Processor -- start 2024-05-08T20:56:47.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 -- start start 2024-05-08T20:56:47.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe5c0b1f60 0x7efe5c15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe5c0cdc20 0x7efe5c13e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 0x7efe5c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c13fc10 con 0x7efe5c0ce000 2024-05-08T20:56:47.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c15b6a0 con 0x7efe5c0b1f60 2024-05-08T20:56:47.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe6230a700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c13f000 con 0x7efe5c0cdc20 2024-05-08T20:56:47.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 0x7efe5c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 0x7f56c00cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56c015e760 0x7f56c00ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c01f88a0 con 0x7f56c00cef90 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c015a3b0 con 0x7f56c00d1140 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56bf59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0159b90 con 0x7f56c015e760 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 0x7efe5c0b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50646/0 (socket says 172.21.15.107:50646) 2024-05-08T20:56:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 -- 172.21.15.107:0/2062652684 learned_addr learned my addr 172.21.15.107:0/2062652684 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1783fff700 1 -- 172.21.15.107:0/2485557591 shutdown_connections 2024-05-08T20:56:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1783fff700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 0x7f17840acd70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1783fff700 1 --2- 172.21.15.107:0/2485557591 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1784160c80 0x7f1784161060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f1783fff700 1 -- 172.21.15.107:0/2485557591 >> 172.21.15.107:0/2485557591 conn(0x7f17840aebd0 msgr2=0x7f17840aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f96826c6700 1 -- start start 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56be59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 0x7f56c01f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56be59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 0x7f56c01f8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50658/0 (socket says 172.21.15.107:50658) 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7f56be59c700 1 -- 172.21.15.107:0/3881585973 learned_addr learned my addr 172.21.15.107:0/3881585973 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56be59c700 1 -- 172.21.15.107:0/3881585973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56c015e760 msgr2=0x7f56c00ccbb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56be59c700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56c015e760 0x7f56c00ccbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56be59c700 1 -- 172.21.15.107:0/3881585973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 msgr2=0x7f56c00cc670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56be59c700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 0x7f56c00cc670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56be59c700 1 -- 172.21.15.107:0/3881585973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b40094b0 con 0x7f56c00cef90 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe60b07700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe5c0cdc20 0x7efe5c13e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61308700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe5c0b1f60 0x7efe5c15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 -- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe5c0cdc20 msgr2=0x7efe5c13e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe5c0cdc20 0x7efe5c13e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 -- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe5c0b1f60 msgr2=0x7efe5c15b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe5c0b1f60 0x7efe5c15b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe61b09700 1 -- 172.21.15.107:0/2062652684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009570 con 0x7efe5c0ce000 2024-05-08T20:56:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7efe60b07700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe5c0cdc20 0x7efe5c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:47.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe61b09700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 0x7efe5c0b3810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe5c074730 tx=0x7efe58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff399333700 1 -- 172.21.15.107:0/3171388872 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00e070 con 0x7ff39406b370 2024-05-08T20:56:47.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff399333700 1 -- 172.21.15.107:0/3171388872 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00bbd0 con 0x7ff39406b370 2024-05-08T20:56:47.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7ff399333700 1 -- 172.21.15.107:0/3171388872 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c012430 con 0x7ff39406b370 2024-05-08T20:56:47.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 -- 172.21.15.107:0/2929965896 shutdown_connections 2024-05-08T20:56:47.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.676+0000 7fee20911700 1 -- 172.21.15.107:0/2929965896 wait complete. 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96826c6700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c0b4b60 0x7f967c151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96826c6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f967c0cd310 0x7f967c1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96826c6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c159560 0x7f967c1f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96826c6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c14a160 con 0x7f967c0cd310 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96826c6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c152a10 con 0x7f967c159560 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96826c6700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c149b10 con 0x7f967c0b4b60 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f9681ec5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c159560 0x7f967c1f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f9681ec5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c159560 0x7f967c1f4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38660/0 (socket says 172.21.15.107:38660) 2024-05-08T20:56:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f9681ec5700 1 -- 172.21.15.107:0/706456712 learned_addr learned my addr 172.21.15.107:0/706456712 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 -- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 msgr2=0x7ff39406b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 --2- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39406b800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009d90 tx=0x7ff38c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fb1e1228700 1 -- 172.21.15.107:0/1331164145 wait complete. 2024-05-08T20:56:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56be59c700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 0x7f56c01f8360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56b800cc20 tx=0x7f56b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8003c20 con 0x7f56c00cef90 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8003da0 con 0x7f56c00cef90 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b800ac60 con 0x7f56c00cef90 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c015a650 con 0x7f56c00cef90 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c0159e70 con 0x7f56c00cef90 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580038c0 con 0x7efe5c0ce000 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58027070 con 0x7efe5c0ce000 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58003c60 con 0x7efe5c0ce000 2024-05-08T20:56:47.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c13f2e0 con 0x7efe5c0ce000 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c13f8a0 con 0x7efe5c0ce000 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- 172.21.15.107:0/2625005678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 msgr2=0x7ff290162360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- 172.21.15.107:0/2625005678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff290162360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff29015f820 tx=0x7ff28800b330 comp rx=0 tx=0).stop 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- 172.21.15.107:0/2625005678 shutdown_connections 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- 172.21.15.107:0/2625005678 >> v2:172.21.15.195:3300/0 conn(0x7ff2901628a0 0x7ff290144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- 172.21.15.107:0/2625005678 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff290162360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- 172.21.15.107:0/2625005678 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff2901478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- 172.21.15.107:0/2625005678 >> 172.21.15.107:0/2625005678 conn(0x7ff29006a360 msgr2=0x7ff29006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- 172.21.15.107:0/2625005678 shutdown_connections 2024-05-08T20:56:47.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- 172.21.15.107:0/2625005678 wait complete. 2024-05-08T20:56:47.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c0b4b60 0x7f967c151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 -- 172.21.15.107:0/3171388872 shutdown_connections 2024-05-08T20:56:47.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 --2- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39406b800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 --2- 172.21.15.107:0/3171388872 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff3940b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 -- 172.21.15.107:0/3171388872 >> 172.21.15.107:0/3171388872 conn(0x7ff394070960 msgr2=0x7ff394070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 Processor -- start 2024-05-08T20:56:47.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f1783fff700 1 -- 172.21.15.107:0/2485557591 shutdown_connections 2024-05-08T20:56:47.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 -- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c159560 msgr2=0x7f967c1f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c159560 0x7f967c1f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 -- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f967c0cd310 msgr2=0x7f967c1520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f967c0cd310 0x7f967c1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 -- 172.21.15.107:0/706456712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674009b30 con 0x7f967c0b4b60 2024-05-08T20:56:47.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c00d2ad0 con 0x7f56c00cef90 2024-05-08T20:56:47.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 -- start start 2024-05-08T20:56:47.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 Processor -- start 2024-05-08T20:56:47.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- start start 2024-05-08T20:56:47.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f96816c4700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c0b4b60 0x7f967c151b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f967800d5f0 tx=0x7f967800d9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96780125f0 con 0x7f967c0b4b60 2024-05-08T20:56:47.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678012750 con 0x7f967c0b4b60 2024-05-08T20:56:47.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678012b00 con 0x7f967c0b4b60 2024-05-08T20:56:47.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c149df0 con 0x7f967c0b4b60 2024-05-08T20:56:47.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c0ae250 con 0x7f967c0b4b60 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff39b337700 1 -- 172.21.15.107:0/3171388872 shutdown_connections 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff39b337700 1 -- 172.21.15.107:0/3171388872 wait complete. 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fb1e1228700 1 Processor -- start 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fb1e1228700 1 -- start start 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1dc15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc15f7e0 0x7fb1dc0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc15ed60 0x7fb1dc0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc1604f0 con 0x7fb1dc15ed60 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15fc80 con 0x7fb1c4005350 2024-05-08T20:56:47.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15d4d0 con 0x7fb1dc15f7e0 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1dc15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1dc15f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38682/0 (socket says 172.21.15.107:38682) 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 -- 172.21.15.107:0/2455795724 learned_addr learned my addr 172.21.15.107:0/2455795724 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 -- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc15f7e0 msgr2=0x7fb1dc0af390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc15f7e0 0x7fb1dc0af390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 -- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc15ed60 msgr2=0x7fb1dc0af8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc15ed60 0x7fb1dc0af8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 -- 172.21.15.107:0/2455795724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc15d7b0 con 0x7fb1c4005350 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1dbfff700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1dc15f2a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00d4a0 tx=0x7fb1cc00d860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0128c0 con 0x7fb1c4005350 2024-05-08T20:56:47.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 -- 172.21.15.107:0/2485557591 wait complete. 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 Processor -- start 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 -- start start 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56b80050d0 con 0x7f56c00cef90 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56aeffd700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f56a0066730 0x7f56a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56b80842b0 con 0x7f56c00cef90 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7f56bdd9b700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f56a0066730 0x7f56a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f56bdd9b700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f56a0066730 0x7f56a0068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009850 tx=0x7f56b4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c06d820 0x7fee1c1fb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c072120 0x7fee1c142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 0x7fee1c143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c147e40 con 0x7fee1c072120 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c144330 con 0x7fee1c06d820 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7fee20911700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c1fb950 con 0x7fee1c0ce160 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 0x7fee1c143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c06d820 0x7fee1c1fb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 0x7fee1c143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53878/0 (socket says 172.21.15.107:53878) 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 -- 172.21.15.107:0/1290043364 learned_addr learned my addr 172.21.15.107:0/1290043364 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 -- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c06d820 msgr2=0x7fee1c1fb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c06d820 0x7fee1c1fb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 -- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c072120 msgr2=0x7fee1c142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c072120 0x7fee1c142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 -- 172.21.15.107:0/1290043364 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10009570 con 0x7fee1c0ce160 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee1b59e700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 0x7fee1c143530 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00e7f0 tx=0x7fee0c00eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c013680 con 0x7fee1c0ce160 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c1409d0 con 0x7fee1c0ce160 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c140130 con 0x7fee1c0ce160 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c013800 con 0x7fee1c0ce160 2024-05-08T20:56:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c013bb0 con 0x7fee1c0ce160 2024-05-08T20:56:47.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe5801a430 con 0x7efe5c0ce000 2024-05-08T20:56:47.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c13fdc0 con 0x7efe5c0ce000 2024-05-08T20:56:47.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe51ffb700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efe40066780 0x7efe40068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe58029070 con 0x7efe5c0ce000 2024-05-08T20:56:47.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7efe61308700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efe40066780 0x7efe40068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7efe61308700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efe40066780 0x7efe40068c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe54009fd0 tx=0x7efe540098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff29013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2901628a0 0x7ff29015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff29013b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29015f230 con 0x7ff290165240 2024-05-08T20:56:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900ce3d0 con 0x7ff2901628a0 2024-05-08T20:56:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff2957a1700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900ce6b0 con 0x7ff2900cb3b0 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff28f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff29013b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff28f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff29013b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50674/0 (socket says 172.21.15.107:50674) 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff28f7fe700 1 -- 172.21.15.107:0/3243789380 learned_addr learned my addr 172.21.15.107:0/3243789380 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2901628a0 0x7ff29015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.680+0000 7ff28effd700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff29013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff28e7fc700 1 -- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 msgr2=0x7ff29013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff29013fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.745 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff28e7fc700 1 -- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 msgr2=0x7ff29013b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff29013b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff28e7fc700 1 -- 172.21.15.107:0/3243789380 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009a70 con 0x7ff2901628a0 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff28e7fc700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2901628a0 0x7ff29015b7f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff288016000 tx=0x7ff288004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288004550 con 0x7ff2901628a0 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff2957a1700 1 -- 172.21.15.107:0/3243789380 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2900ce990 con 0x7ff2901628a0 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff2957a1700 1 -- 172.21.15.107:0/3243789380 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29015c8d0 con 0x7ff2901628a0 2024-05-08T20:56:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff288020070 con 0x7ff2901628a0 2024-05-08T20:56:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880048b0 con 0x7ff2901628a0 2024-05-08T20:56:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc15da90 con 0x7fb1c4005350 2024-05-08T20:56:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc15e290 con 0x7fb1c4005350 2024-05-08T20:56:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff39b337700 1 Processor -- start 2024-05-08T20:56:47.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7ff39b337700 1 -- start start 2024-05-08T20:56:47.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc012a20 con 0x7fb1c4005350 2024-05-08T20:56:47.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc012d90 con 0x7fb1c4005350 2024-05-08T20:56:47.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 0x7f1784145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17840b1f60 0x7f178415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1784160c80 0x7f178415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17841448e0 con 0x7f1784160c80 2024-05-08T20:56:47.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840c3ed0 con 0x7f17840ac8e0 2024-05-08T20:56:47.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f1783fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1784144600 con 0x7f17840b1f60 2024-05-08T20:56:47.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17827fc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17840b1f60 0x7f178415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17827fc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17840b1f60 0x7f178415c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53894/0 (socket says 172.21.15.107:53894) 2024-05-08T20:56:47.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17827fc700 1 -- 172.21.15.107:0/1869717337 learned_addr learned my addr 172.21.15.107:0/1869717337 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17837fe700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1784160c80 0x7f178415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc005310 con 0x7fb1c4005350 2024-05-08T20:56:47.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17837fe700 1 -- 172.21.15.107:0/1869717337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17840b1f60 msgr2=0x7f178415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17837fe700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17840b1f60 0x7f178415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17837fe700 1 -- 172.21.15.107:0/1869717337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 msgr2=0x7f1784145e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:56:47.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17837fe700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 0x7f1784145e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f17837fe700 1 -- 172.21.15.107:0/1869717337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780094b0 con 0x7f1784160c80 2024-05-08T20:56:47.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fee017fa700 1 -- 172.21.15.107:0/1290043364 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c147fb0 con 0x7fee1c0ce160 2024-05-08T20:56:47.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.684+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9678012c60 con 0x7f967c0b4b60 2024-05-08T20:56:47.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f966dffb700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9660066800 0x7f9660068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9678084310 con 0x7f967c0b4b60 2024-05-08T20:56:47.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39b337700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39b337700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 0x7ff3940a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39b337700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff394148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39b337700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940abfb0 con 0x7ff3940b3e80 2024-05-08T20:56:47.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39b337700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415b2c0 con 0x7ff39406b370 2024-05-08T20:56:47.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39b337700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415b5a0 con 0x7ff394159ef0 2024-05-08T20:56:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f17837fe700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1784160c80 0x7f178415caa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17840b1c80 tx=0x7f1778004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 0x7ff3940a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39ab36700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff394148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 0x7ff3940a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50692/0 (socket says 172.21.15.107:50692) 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 -- 172.21.15.107:0/357528167 learned_addr learned my addr 172.21.15.107:0/357528167 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39a335700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1cc01b400 con 0x7fb1c4005350 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee0c013d10 con 0x7fee1c0ce160 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fee037fe700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fee08088740 0x7fee0808ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee0c084010 con 0x7fee1c0ce160 2024-05-08T20:56:47.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fee1ad9d700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fee08088740 0x7fee0808ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 -- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 msgr2=0x7ff394148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff394148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 -- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 msgr2=0x7ff39415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:47.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:47.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 -- 172.21.15.107:0/357528167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c009a70 con 0x7ff3940b3e80 2024-05-08T20:56:47.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff39ab36700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff394148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:47.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fb1d8ff9700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c8066730 0x7fb1c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f9680ec3700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9660066800 0x7f9660068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c0684b0 con 0x7f967c0b4b60 2024-05-08T20:56:47.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f9680ec3700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9660066800 0x7f9660068cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f967c0adde0 tx=0x7f9670007a00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fee1ad9d700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fee08088740 0x7fee0808ac00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fee1400f290 tx=0x7fee14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fb1db7fe700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c8066730 0x7fb1c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1cc084100 con 0x7fb1c4005350 2024-05-08T20:56:47.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff399b34700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 0x7ff3940a9f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c4f0 tx=0x7ff39000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff288012430 con 0x7ff2901628a0 2024-05-08T20:56:47.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7fb1db7fe700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c8066730 0x7fb1c8068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0ac8b0 tx=0x7fb1d4009120 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff2777fe700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff27c066730 0x7ff27c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff28effd700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff27c066730 0x7ff27c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff288022070 con 0x7ff2901628a0 2024-05-08T20:56:47.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7ff28effd700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff27c066730 0x7ff27c068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff280009a00 tx=0x7ff280008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.688+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f56b8051610 con 0x7f56c00cef90 2024-05-08T20:56:47.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.692+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2900ce7f0 con 0x7ff2901628a0 2024-05-08T20:56:47.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fee1c147fb0 con 0x7fee1c0ce160 2024-05-08T20:56:47.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390005d90 con 0x7ff3940b3e80 2024-05-08T20:56:47.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778011630 con 0x7f1784160c80 2024-05-08T20:56:47.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784130060 con 0x7f1784160c80 2024-05-08T20:56:47.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7efe5c13fdc0 con 0x7efe5c0ce000 2024-05-08T20:56:47.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784130620 con 0x7f1784160c80 2024-05-08T20:56:47.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3900070d0 con 0x7ff3940b3e80 2024-05-08T20:56:47.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39415b880 con 0x7ff3940b3e80 2024-05-08T20:56:47.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb1cc0514e0 con 0x7fb1c4005350 2024-05-08T20:56:47.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177801f070 con 0x7f1784160c80 2024-05-08T20:56:47.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17780119f0 con 0x7f1784160c80 2024-05-08T20:56:47.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39415d0e0 con 0x7ff3940b3e80 2024-05-08T20:56:47.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.696+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff390007440 con 0x7ff3940b3e80 2024-05-08T20:56:47.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.700+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1764005310 con 0x7f1784160c80 2024-05-08T20:56:47.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.700+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c005310 con 0x7ff3940b3e80 2024-05-08T20:56:47.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.700+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9678051660 con 0x7f967c0b4b60 2024-05-08T20:56:47.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.700+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1778011b50 con 0x7f1784160c80 2024-05-08T20:56:47.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.700+0000 7f176bfff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1770066780 0x7f1770068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.700+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1778021070 con 0x7f1784160c80 2024-05-08T20:56:47.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.704+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3900075a0 con 0x7ff3940b3e80 2024-05-08T20:56:47.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.704+0000 7ff38affd700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff38006ac80 0x7ff38006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:47.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.704+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff390083560 con 0x7ff3940b3e80 2024-05-08T20:56:47.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.708+0000 7ff39a335700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff38006ac80 0x7ff38006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.708+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff2900ce7f0 con 0x7ff2901628a0 2024-05-08T20:56:47.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.708+0000 7ff39a335700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff38006ac80 0x7ff38006d140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff384006fd0 tx=0x7ff384009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:47.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.708+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1778053280 con 0x7f1784160c80 2024-05-08T20:56:47.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.716+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ff390050810 con 0x7ff3940b3e80 2024-05-08T20:56:47.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.716+0000 7f1782ffd700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1770066780 0x7f1770068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:47.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:47.720+0000 7f1782ffd700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1770066780 0x7f1770068c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f177c007dd0 tx=0x7f177c007300 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:48.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.016+0000 7fee017fa700 1 -- 172.21.15.107:0/1290043364 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fee1c147fb0 con 0x7fee1c0ce160 2024-05-08T20:56:48.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.016+0000 7fee037fe700 1 -- 172.21.15.107:0/1290043364 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee1c147fb0 con 0x7fee1c0ce160 2024-05-08T20:56:48.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb1bc005890 con 0x7fb1c4005350 2024-05-08T20:56:48.027 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:48.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f56c015ab70 con 0x7f56c00cef90 2024-05-08T20:56:48.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7fb1d8ff9700 1 -- 172.21.15.107:0/2455795724 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1cc054b00 con 0x7fb1c4005350 2024-05-08T20:56:48.031 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-05-08T20:56:48.031 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:48.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7f56aeffd700 1 -- 172.21.15.107:0/3881585973 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56c015ab70 con 0x7f56c00cef90 2024-05-08T20:56:48.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fee08088740 msgr2=0x7fee0808ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7fee20911700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fee08088740 0x7fee0808ac00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fee1400f290 tx=0x7fee14009040 comp rx=0 tx=0).stop 2024-05-08T20:56:48.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 msgr2=0x7fee1c143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7fee20911700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 0x7fee1c143530 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00e7f0 tx=0x7fee0c00eb00 comp rx=0 tx=0).stop 2024-05-08T20:56:48.032 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:48.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe5c0ce4b0 con 0x7efe5c0ce000 2024-05-08T20:56:48.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.020+0000 7efe51ffb700 1 -- 172.21.15.107:0/2062652684 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe5c0ce4b0 con 0x7efe5c0ce000 2024-05-08T20:56:48.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c8066730 msgr2=0x7fb1c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c8066730 0x7fb1c8068bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0ac8b0 tx=0x7fb1d4009120 comp rx=0 tx=0).stop 2024-05-08T20:56:48.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 msgr2=0x7fb1dc15f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1dc15f2a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00d4a0 tx=0x7fb1cc00d860 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 shutdown_connections 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb1dc15ed60 0x7fb1dc0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb1c8066730 0x7fb1c8068bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 shutdown_connections 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fee08088740 0x7fee0808ac00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fee1c0ce160 0x7fee1c143530 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fee1c072120 0x7fee1c142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 --2- 172.21.15.107:0/1290043364 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fee1c06d820 0x7fee1c1fb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 >> 172.21.15.107:0/1290043364 conn(0x7fee1c0aebd0 msgr2=0x7fee1c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb1dc15f7e0 0x7fb1dc0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 --2- 172.21.15.107:0/2455795724 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1c4005350 0x7fb1dc15f2a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 >> 172.21.15.107:0/2455795724 conn(0x7fb1dc0aebd0 msgr2=0x7fb1dc070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 shutdown_connections 2024-05-08T20:56:48.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 shutdown_connections 2024-05-08T20:56:48.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fb1e1228700 1 -- 172.21.15.107:0/2455795724 wait complete. 2024-05-08T20:56:48.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7fee20911700 1 -- 172.21.15.107:0/1290043364 wait complete. 2024-05-08T20:56:48.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efe40066780 msgr2=0x7efe40068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efe40066780 0x7efe40068c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe54009fd0 tx=0x7efe540098d0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 msgr2=0x7efe5c0b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 0x7efe5c0b3810 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe5c074730 tx=0x7efe58004770 comp rx=0 tx=0).stop 2024-05-08T20:56:48.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 shutdown_connections 2024-05-08T20:56:48.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe5c0ce000 0x7efe5c0b3810 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efe40066780 0x7efe40068c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe5c0cdc20 0x7efe5c13e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 --2- 172.21.15.107:0/2062652684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe5c0b1f60 0x7efe5c15b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 >> 172.21.15.107:0/2062652684 conn(0x7efe5c0aebd0 msgr2=0x7efe5c0b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 shutdown_connections 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7efe6230a700 1 -- 172.21.15.107:0/2062652684 wait complete. 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f56a0066730 msgr2=0x7f56a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f56a0066730 0x7f56a0068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009850 tx=0x7f56b4008030 comp rx=0 tx=0).stop 2024-05-08T20:56:48.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 msgr2=0x7f56c01f8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 0x7f56c01f8360 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f56b800cc20 tx=0x7f56b800a060 comp rx=0 tx=0).stop 2024-05-08T20:56:48.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f967c15d900 con 0x7f967c0b4b60 2024-05-08T20:56:48.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 shutdown_connections 2024-05-08T20:56:48.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f56a0066730 0x7f56a0068bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f56c015e760 0x7f56c00ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c00d1140 0x7f56c00cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 --2- 172.21.15.107:0/3881585973 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f56c00cef90 0x7f56c01f8360 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 >> 172.21.15.107:0/3881585973 conn(0x7f56c009c3b0 msgr2=0x7f56c01562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 shutdown_connections 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.024+0000 7f56bf59e700 1 -- 172.21.15.107:0/3881585973 wait complete. 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff29013fb40 con 0x7ff2901628a0 2024-05-08T20:56:48.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f966dffb700 1 -- 172.21.15.107:0/706456712 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9678054c80 con 0x7f967c0b4b60 2024-05-08T20:56:48.041 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-05-08T20:56:48.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7ff2777fe700 1 -- 172.21.15.107:0/3243789380 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff29013fb40 con 0x7ff2901628a0 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9660066800 msgr2=0x7f9660068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9660066800 0x7f9660068cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f967c0adde0 tx=0x7f9670007a00 comp rx=0 tx=0).stop 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c0b4b60 msgr2=0x7f967c151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c0b4b60 0x7f967c151b70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f967800d5f0 tx=0x7f967800d9b0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 shutdown_connections 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f967c159560 0x7f967c1f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f967c0cd310 0x7f967c1520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9660066800 0x7f9660068cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 --2- 172.21.15.107:0/706456712 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f967c0b4b60 0x7f967c151b70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.028+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 >> 172.21.15.107:0/706456712 conn(0x7f967c0aebd0 msgr2=0x7f967c0afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.032+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 shutdown_connections 2024-05-08T20:56:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.032+0000 7f96826c6700 1 -- 172.21.15.107:0/706456712 wait complete. 2024-05-08T20:56:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.032+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1764005890 con 0x7f1784160c80 2024-05-08T20:56:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.032+0000 7f176bfff700 1 -- 172.21.15.107:0/1869717337 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17780568a0 con 0x7f1784160c80 2024-05-08T20:56:48.044 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:48.044 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:48.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1770066780 msgr2=0x7f1770068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1770066780 0x7f1770068c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f177c007dd0 tx=0x7f177c007300 comp rx=0 tx=0).stop 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1784160c80 msgr2=0x7f178415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1784160c80 0x7f178415caa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17840b1c80 tx=0x7f1778004770 comp rx=0 tx=0).stop 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 shutdown_connections 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1784160c80 0x7f178415caa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1770066780 0x7f1770068c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f17840b1f60 0x7f178415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 --2- 172.21.15.107:0/1869717337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ac8e0 0x7f1784145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 >> 172.21.15.107:0/1869717337 conn(0x7f17840aebd0 msgr2=0x7f17840b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 shutdown_connections 2024-05-08T20:56:48.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.036+0000 7f1783fff700 1 -- 172.21.15.107:0/1869717337 wait complete. 2024-05-08T20:56:48.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff27c066730 msgr2=0x7ff27c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff27c066730 0x7ff27c068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff280009a00 tx=0x7ff280008040 comp rx=0 tx=0).stop 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2901628a0 msgr2=0x7ff29015b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2901628a0 0x7ff29015b7f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff288016000 tx=0x7ff288004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 shutdown_connections 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff290165240 0x7ff29013b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2901628a0 0x7ff29015b7f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff27c066730 0x7ff27c068bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 --2- 172.21.15.107:0/3243789380 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff2900cb3b0 0x7ff29013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 >> 172.21.15.107:0/3243789380 conn(0x7ff29006a360 msgr2=0x7ff290142a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 shutdown_connections 2024-05-08T20:56:48.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.040+0000 7ff2757fa700 1 -- 172.21.15.107:0/3243789380 wait complete. 2024-05-08T20:56:48.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-05-08T20:56:48.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-05-08T20:56:48.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-05-08T20:56:48.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.044+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff37c0055c0 con 0x7ff3940b3e80 2024-05-08T20:56:48.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.044+0000 7ff38affd700 1 -- 172.21.15.107:0/357528167 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff390053e30 con 0x7ff3940b3e80 2024-05-08T20:56:48.052 INFO:teuthology.orchestra.run.smithi107.stdout:55834574852 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff38006ac80 msgr2=0x7ff38006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff38006ac80 0x7ff38006d140 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff384006fd0 tx=0x7ff384009190 comp rx=0 tx=0).stop 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 msgr2=0x7ff3940a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 0x7ff3940a9f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c4f0 tx=0x7ff39000c800 comp rx=0 tx=0).stop 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 shutdown_connections 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ff38006ac80 0x7ff38006d140 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ff394159ef0 0x7ff394148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3940b3e80 0x7ff3940a9f60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 --2- 172.21.15.107:0/357528167 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff39406b370 0x7ff39415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:48.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 >> 172.21.15.107:0/357528167 conn(0x7ff394070960 msgr2=0x7ff394066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:48.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 shutdown_connections 2024-05-08T20:56:48.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:48.048+0000 7ff39b337700 1 -- 172.21.15.107:0/357528167 wait complete. 2024-05-08T20:56:48.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-05-08T20:56:48.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-05-08T20:56:48.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-08T20:56:48.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-08T20:56:48.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-05-08T20:56:49.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T20:56:49.052 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T20:56:49.052 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T20:56:49.058 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T20:56:49.062 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T20:56:49.064 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T20:56:49.065 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T20:56:49.069 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T20:56:49.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.184+0000 7fb862e5f700 1 Processor -- start 2024-05-08T20:56:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 -- start start 2024-05-08T20:56:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb85c0cdc20 0x7fb85c06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb85c0ce000 0x7fb85c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0b2d90 con 0x7fb85c0b1f60 2024-05-08T20:56:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c150680 con 0x7fb85c0cdc20 2024-05-08T20:56:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0ce4b0 con 0x7fb85c0ce000 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb85c0cdc20 0x7fb85c06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb85c0cdc20 0x7fb85c06d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50702/0 (socket says 172.21.15.107:50702) 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 -- 172.21.15.107:0/3252428840 learned_addr learned my addr 172.21.15.107:0/3252428840 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 -- 172.21.15.107:0/3252428840 >> v2:172.21.15.195:3300/0 conn(0x7fb85c0ce000 msgr2=0x7fb85c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 --2- 172.21.15.107:0/3252428840 >> v2:172.21.15.195:3300/0 conn(0x7fb85c0ce000 0x7fb85c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 -- 172.21.15.107:0/3252428840 >> v1:172.21.15.195:6789/0 conn(0x7fb85c0b1f60 legacy=0x7fb85c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 -- 172.21.15.107:0/3252428840 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c06d390 con 0x7fb85c0cdc20 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb860bfb700 1 --2- 172.21.15.107:0/3252428840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cdc20 0x7fb85c06d820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb85c06d300 tx=0x7fb85400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9e872c630199b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb85b7fe700 1 -- 172.21.15.107:0/3252428840 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854010070 con 0x7fb85c0cdc20 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb85b7fe700 1 -- 172.21.15.107:0/3252428840 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400dca0 con 0x7fb85c0cdc20 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 -- 172.21.15.107:0/3252428840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cdc20 msgr2=0x7fb85c06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.188+0000 7fb862e5f700 1 --2- 172.21.15.107:0/3252428840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cdc20 0x7fb85c06d820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb85c06d300 tx=0x7fb85400d650 comp rx=0 tx=0).stop 2024-05-08T20:56:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 -- 172.21.15.107:0/3252428840 shutdown_connections 2024-05-08T20:56:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 --2- 172.21.15.107:0/3252428840 >> v2:172.21.15.195:3300/0 conn(0x7fb85c0ce000 0x7fb85c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 --2- 172.21.15.107:0/3252428840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c0cdc20 0x7fb85c06d820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 -- 172.21.15.107:0/3252428840 >> 172.21.15.107:0/3252428840 conn(0x7fb85c0aebd0 msgr2=0x7fb85c0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 -- 172.21.15.107:0/3252428840 shutdown_connections 2024-05-08T20:56:49.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 -- 172.21.15.107:0/3252428840 wait complete. 2024-05-08T20:56:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 Processor -- start 2024-05-08T20:56:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 Processor -- start 2024-05-08T20:56:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 -- start start 2024-05-08T20:56:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb85c0b1f60 0x7fb85c202400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb85c0ce000 0x7fb85c158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 -- start start 2024-05-08T20:56:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe59006d820 0x7fe5900ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5900b1f60 0x7fe5900b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900b2d90 con 0x7fe5900cdc20 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe590150680 con 0x7fe5900b1f60 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe595db2700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59006dcd0 con 0x7fe59006d820 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe58ffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe5900b1f60 0x7fe5900b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe58f7fe700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fe5900cdc20 0x7fe59015a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50116/0 (socket says 172.21.15.107:50116) 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fe58f7fe700 1 -- 172.21.15.107:0/3932943348 learned_addr learned my addr 172.21.15.107:0/3932943348 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb862e5f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 0x7fb85c1e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb860bfb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb85c0b1f60 0x7fb85c202400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.192+0000 7fb860bfb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb85c0b1f60 0x7fb85c202400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38718/0 (socket says 172.21.15.107:38718) 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb85bfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb85c0ce000 0x7fb85c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb85bfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb85c0ce000 0x7fb85c158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53916/0 (socket says 172.21.15.107:53916) 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 0x7fb85c1e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 0x7fb85c1e3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50720/0 (socket says 172.21.15.107:50720) 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58ffff700 1 -- 172.21.15.107:0/3932943348 >> v2:172.21.15.195:3300/0 conn(0x7fe59006d820 msgr2=0x7fe5900ce000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58ffff700 1 --2- 172.21.15.107:0/3932943348 >> v2:172.21.15.195:3300/0 conn(0x7fe59006d820 0x7fe5900ce000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58ffff700 1 -- 172.21.15.107:0/3932943348 >> v1:172.21.15.195:6789/0 conn(0x7fe5900cdc20 legacy=0x7fe59015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58ffff700 1 -- 172.21.15.107:0/3932943348 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59006d390 con 0x7fe5900b1f60 2024-05-08T20:56:49.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58ffff700 1 --2- 172.21.15.107:0/3932943348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe5900b23d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe59006d300 tx=0x7fe58800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb3031766575e2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 Processor -- start 2024-05-08T20:56:49.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb862e5f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1e56e0 con 0x7fb85c158640 2024-05-08T20:56:49.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb862e5f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c158af0 con 0x7fb85c0b1f60 2024-05-08T20:56:49.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb862e5f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1e4a60 con 0x7fb85c0ce000 2024-05-08T20:56:49.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb860bfb700 1 -- 172.21.15.107:0/1019910899 learned_addr learned my addr 172.21.15.107:0/1019910899 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58e7fc700 1 -- 172.21.15.107:0/3932943348 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588010070 con 0x7fe5900b1f60 2024-05-08T20:56:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 -- 172.21.15.107:0/1019910899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb85c0ce000 msgr2=0x7fb85c158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb85c0ce000 0x7fb85c158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 -- 172.21.15.107:0/1019910899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb85c0b1f60 msgr2=0x7fb85c202400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb85c0b1f60 0x7fb85c202400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 -- 172.21.15.107:0/1019910899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85400d050 con 0x7fb85c158640 2024-05-08T20:56:49.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe58e7fc700 1 -- 172.21.15.107:0/3932943348 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800b2e0 con 0x7fe5900b1f60 2024-05-08T20:56:49.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8613fc700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 0x7fb85c1e3d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c410 tx=0x7fb84c00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 -- start start 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3c000cdc20 0x7f3c0006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 0x7f3c0015a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3c000b1f60 0x7f3c000b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c00150680 con 0x7f3c000b1f60 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000b2910 con 0x7f3c000cdc20 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c06e37700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000b2d90 con 0x7f3c000ce000 2024-05-08T20:56:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c012620 con 0x7fb85c158640 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c0127c0 con 0x7fb85c158640 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c012b70 con 0x7fb85c158640 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 0x7f3c0015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c053d4700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3c000b1f60 0x7f3c000b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 0x7f3c0015a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53928/0 (socket says 172.21.15.107:53928) 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 -- 172.21.15.107:0/2231793075 learned_addr learned my addr 172.21.15.107:0/2231793075 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb862e5f700 1 -- 172.21.15.107:0/1019910899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c1e4d40 con 0x7fb85c158640 2024-05-08T20:56:49.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fb862e5f700 1 -- 172.21.15.107:0/1019910899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c1e5300 con 0x7fb85c158640 2024-05-08T20:56:49.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe595db2700 1 -- 172.21.15.107:0/3932943348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 msgr2=0x7fe5900b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe595db2700 1 --2- 172.21.15.107:0/3932943348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe5900b23d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe59006d300 tx=0x7fe58800d330 comp rx=0 tx=0).stop 2024-05-08T20:56:49.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 -- 172.21.15.107:0/2231793075 >> v2:172.21.15.195:3300/0 conn(0x7f3c000cdc20 msgr2=0x7f3c0006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c04bd3700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.195:3300/0 conn(0x7f3c000cdc20 0x7f3c0006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.195:3300/0 conn(0x7f3c000cdc20 0x7f3c0006d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 -- 172.21.15.107:0/2231793075 >> v2:172.21.15.107:3300/0 conn(0x7f3c000b1f60 msgr2=0x7f3c000b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.107:3300/0 conn(0x7f3c000b1f60 0x7f3c000b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 -- 172.21.15.107:0/2231793075 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0006d390 con 0x7f3c000ce000 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c053d4700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.107:3300/0 conn(0x7f3c000b1f60 0x7f3c000b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3c04bd3700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.195:3300/0 conn(0x7f3c000cdc20 0x7f3c0006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe595db2700 1 -- 172.21.15.107:0/3932943348 shutdown_connections 2024-05-08T20:56:49.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe595db2700 1 --2- 172.21.15.107:0/3932943348 >> v2:172.21.15.195:3300/0 conn(0x7fe59006d820 0x7fe5900ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe595db2700 1 --2- 172.21.15.107:0/3932943348 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe5900b23d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7fe595db2700 1 -- 172.21.15.107:0/3932943348 >> 172.21.15.107:0/3932943348 conn(0x7fe5900aebd0 msgr2=0x7fe5900aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bfffff700 1 --2- 172.21.15.107:0/2231793075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 0x7f3c0015a150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0006fd0 tx=0x7f3bf000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb78137d22b2aedc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bff7fe700 1 -- 172.21.15.107:0/2231793075 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000dbe0 con 0x7f3c000ce000 2024-05-08T20:56:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.196+0000 7f3bff7fe700 1 -- 172.21.15.107:0/2231793075 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf000dd40 con 0x7f3c000ce000 2024-05-08T20:56:49.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 -- 172.21.15.107:0/2231793075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 msgr2=0x7f3c0015a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 --2- 172.21.15.107:0/2231793075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 0x7f3c0015a150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0006fd0 tx=0x7f3bf000bea0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fe595db2700 1 -- 172.21.15.107:0/3932943348 shutdown_connections 2024-05-08T20:56:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fe595db2700 1 -- 172.21.15.107:0/3932943348 wait complete. 2024-05-08T20:56:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 -- 172.21.15.107:0/2231793075 shutdown_connections 2024-05-08T20:56:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.107:3300/0 conn(0x7f3c000b1f60 0x7f3c000b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 --2- 172.21.15.107:0/2231793075 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c000ce000 0x7f3c0015a150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 --2- 172.21.15.107:0/2231793075 >> v2:172.21.15.195:3300/0 conn(0x7f3c000cdc20 0x7f3c0006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 -- 172.21.15.107:0/2231793075 >> 172.21.15.107:0/2231793075 conn(0x7f3c000aebd0 msgr2=0x7f3c000aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb84c012cd0 con 0x7fb85c158640 2024-05-08T20:56:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fb862e5f700 1 -- 172.21.15.107:0/1019910899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c1e5820 con 0x7fb85c158640 2024-05-08T20:56:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fb8597fa700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8480667b0 0x7fb848068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb84c083ca0 con 0x7fb85c158640 2024-05-08T20:56:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 -- 172.21.15.107:0/2231793075 shutdown_connections 2024-05-08T20:56:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 -- 172.21.15.107:0/2231793075 wait complete. 2024-05-08T20:56:49.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 Processor -- start 2024-05-08T20:56:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7f3c06e37700 1 -- start start 2024-05-08T20:56:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c06e37700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 0x7f3c00158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c06e37700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c000cdc20 0x7f3c0013ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c06e37700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c0013f460 0x7f3c001fef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fe595db2700 1 Processor -- start 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.200+0000 7fe595db2700 1 -- start start 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 0x7fe5901ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe590156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5900cdc20 0x7fe590156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59013e0a0 con 0x7fe5900b1f60 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59013e2f0 con 0x7fe59006d820 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe590140bd0 con 0x7fe5900cdc20 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 0x7fe5901ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58ffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5900cdc20 0x7fe590156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 0x7fe5901ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38734/0 (socket says 172.21.15.107:38734) 2024-05-08T20:56:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58ffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5900cdc20 0x7fe590156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53942/0 (socket says 172.21.15.107:53942) 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 -- 172.21.15.107:0/3378182539 learned_addr learned my addr 172.21.15.107:0/3378182539 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58effd700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe590156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 -- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5900cdc20 msgr2=0x7fe590156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5900cdc20 0x7fe590156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 -- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 msgr2=0x7fe590156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe590156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 -- 172.21.15.107:0/3378182539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58800bc80 con 0x7fe59006d820 2024-05-08T20:56:49.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58effd700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe590156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 0x7f3c00158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 0x7f3c00158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50742/0 (socket says 172.21.15.107:50742) 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 -- 172.21.15.107:0/3402943108 learned_addr learned my addr 172.21.15.107:0/3402943108 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c053d4700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c0013f460 0x7f3c001fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c06e37700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001557e0 con 0x7f3c000b1f60 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3bfffff700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c000cdc20 0x7f3c0013ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c06e37700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0013f910 con 0x7f3c000cdc20 2024-05-08T20:56:49.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe58f7fe700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 0x7fe5901ee0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe58002e660 tx=0x7fe58002e970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fb860bfb700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8480667b0 0x7fb848068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c06e37700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00154c60 con 0x7f3c0013f460 2024-05-08T20:56:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580032890 con 0x7fe59006d820 2024-05-08T20:56:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fb860bfb700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8480667b0 0x7fb848068c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d690 tx=0x7fb854012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe590140eb0 con 0x7fe59006d820 2024-05-08T20:56:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 -- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c0013f460 msgr2=0x7f3c001fef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c0013f460 0x7f3c001fef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 -- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c000cdc20 msgr2=0x7f3c0013ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c000cdc20 0x7f3c0013ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8005e20 con 0x7f3c000b1f60 2024-05-08T20:56:49.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe590151810 con 0x7fe59006d820 2024-05-08T20:56:49.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe580008040 con 0x7fe59006d820 2024-05-08T20:56:49.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580032c50 con 0x7fe59006d820 2024-05-08T20:56:49.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.204+0000 7f3c04bd3700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 0x7f3c00158bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c7c0 tx=0x7f3bf400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe58003b400 con 0x7fe59006d820 2024-05-08T20:56:49.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe570005310 con 0x7fe59006d820 2024-05-08T20:56:49.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fe577fff700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe57c066730 0x7fe57c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5800a6570 con 0x7fe59006d820 2024-05-08T20:56:49.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fe58effd700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe57c066730 0x7fe57c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb85c1e5820 con 0x7fb85c158640 2024-05-08T20:56:49.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.208+0000 7fe58effd700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe57c066730 0x7fe57c068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe590143e10 tx=0x7fe584009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.212+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4011800 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.212+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4011960 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.212+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4011cf0 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.212+0000 7f3c06e37700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf000b820 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.212+0000 7f3c06e37700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c00155220 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.216+0000 7f3c06e37700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000684b0 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.216+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3bf4023480 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.216+0000 7f3bfd7fa700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3bec066780 0x7f3bec068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.216+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bf4084290 con 0x7f3c000b1f60 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.216+0000 7f3bfffff700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3bec066780 0x7f3bec068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.216+0000 7f3bfffff700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3bec066780 0x7f3bec068c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0000c00 tx=0x7f3bf0014000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.220+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe580073970 con 0x7fe59006d820 2024-05-08T20:56:49.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.220+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3bf4051770 con 0x7f3c000b1f60 2024-05-08T20:56:49.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 Processor -- start 2024-05-08T20:56:49.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 -- start start 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f140406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f14040b4cf0 0x7f140406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040b43e0 con 0x7f140416f0e0 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14040b3e00 con 0x7f14040b4cf0 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409e21700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14040b23b0 con 0x7f14040b4870 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1403fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f140406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1409620700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f14040b4cf0 0x7f140406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1408e1f700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f140416f0e0 0x7f140406e4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50126/0 (socket says 172.21.15.107:50126) 2024-05-08T20:56:49.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f1408e1f700 1 -- 172.21.15.107:0/3585309432 learned_addr learned my addr 172.21.15.107:0/3585309432 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:49.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f09e1e46700 1 Processor -- start 2024-05-08T20:56:49.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f94db59e700 1 Processor -- start 2024-05-08T20:56:49.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f94db59e700 1 -- start start 2024-05-08T20:56:49.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.240+0000 7f09e1e46700 1 -- start start 2024-05-08T20:56:49.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 Processor -- start 2024-05-08T20:56:49.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 -- start start 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94dc0cdc20 0x7f94dc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f94dc072120 0x7f94dc0ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc0b2d90 con 0x7f94dc15a150 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc150680 con 0x7f94dc0cdc20 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc06d390 con 0x7f94dc072120 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94dad9d700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f94dc15a150 0x7f94dc0b1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60966/0 (socket says 172.21.15.107:60966) 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94dad9d700 1 -- 172.21.15.107:0/2961825717 learned_addr learned my addr 172.21.15.107:0/2961825717 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94da59c700 1 --2- 172.21.15.107:0/2961825717 >> v2:172.21.15.107:3300/0 conn(0x7f94dc0cdc20 0x7f94dc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94da59c700 1 -- 172.21.15.107:0/2961825717 >> v2:172.21.15.195:3300/0 conn(0x7f94dc072120 msgr2=0x7f94dc0ce000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94da59c700 1 --2- 172.21.15.107:0/2961825717 >> v2:172.21.15.195:3300/0 conn(0x7f94dc072120 0x7f94dc0ce000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94da59c700 1 -- 172.21.15.107:0/2961825717 >> v1:172.21.15.107:6789/0 conn(0x7f94dc15a150 legacy=0x7f94dc0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94d959a700 1 -- 172.21.15.107:0/2961825717 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626105256 0 0) 0x7f94dc0b2d90 con 0x7f94dc15a150 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94da59c700 1 -- 172.21.15.107:0/2961825717 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc06c780 con 0x7f94dc0cdc20 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1403fff700 1 -- 172.21.15.107:0/3585309432 >> v2:172.21.15.195:3300/0 conn(0x7f14040b4cf0 msgr2=0x7f140406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1403fff700 1 --2- 172.21.15.107:0/3585309432 >> v2:172.21.15.195:3300/0 conn(0x7f14040b4cf0 0x7f140406cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1403fff700 1 -- 172.21.15.107:0/3585309432 >> v1:172.21.15.195:6789/0 conn(0x7f140416f0e0 legacy=0x7f140406e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1403fff700 1 -- 172.21.15.107:0/3585309432 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040b4070 con 0x7f14040b4870 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409620700 1 --2- 172.21.15.107:0/3585309432 >> v2:172.21.15.195:3300/0 conn(0x7f14040b4cf0 0x7f140406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1403fff700 1 --2- 172.21.15.107:0/3585309432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f140406c800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009850 tx=0x7f13f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38d85ef72724d7a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f14037fe700 1 -- 172.21.15.107:0/3585309432 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4011830 con 0x7f14040b4870 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f14037fe700 1 -- 172.21.15.107:0/3585309432 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4011990 con 0x7f14040b4870 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f14037fe700 1 -- 172.21.15.107:0/3585309432 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4011d40 con 0x7f14040b4870 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94da59c700 1 --2- 172.21.15.107:0/2961825717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0cdc20 0x7f94dc06d820 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009850 tx=0x7f94d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bd407f82b69ab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 0x7fc53406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc5340ac8e0 0x7fc5340acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5340b2740 con 0x7fc534160c80 2024-05-08T20:56:49.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53406d990 con 0x7fc5340ac8e0 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5389de700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc534146d60 con 0x7fc5340b1f60 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 -- 172.21.15.107:0/3585309432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 msgr2=0x7f140406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 --2- 172.21.15.107:0/3585309432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f140406c800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009850 tx=0x7f13f4009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 -- 172.21.15.107:0/3585309432 shutdown_connections 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 --2- 172.21.15.107:0/3585309432 >> v2:172.21.15.195:3300/0 conn(0x7f14040b4cf0 0x7f140406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 --2- 172.21.15.107:0/3585309432 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f140406c800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 -- 172.21.15.107:0/3585309432 >> 172.21.15.107:0/3585309432 conn(0x7f14040aebd0 msgr2=0x7f14040aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 -- 172.21.15.107:0/3585309432 shutdown_connections 2024-05-08T20:56:49.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 -- 172.21.15.107:0/3585309432 wait complete. 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e1e46700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f09dc0ce510 0x7f09dc15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e1e46700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc15aaa0 0x7f09dc13d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e1e46700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09dc0ce080 con 0x7f09dc071ab0 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e0e44700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f09dc071ab0 0x7f09dc071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:60992/0 (socket says 172.21.15.107:60992) 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e0e44700 1 -- 172.21.15.107:0/2570709191 learned_addr learned my addr 172.21.15.107:0/2570709191 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0cd7c0 con 0x7f09dc0ce510 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0cda30 con 0x7f09dc15aaa0 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09dbfff700 1 --2- 172.21.15.107:0/2570709191 >> v2:172.21.15.107:3300/0 conn(0x7f09dc0ce510 0x7f09dc15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09e1645700 1 --2- 172.21.15.107:0/2570709191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc15aaa0 0x7f09dc13d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09db7fe700 1 -- 172.21.15.107:0/2570709191 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265973477 0 0) 0x7f09dc0ce080 con 0x7f09dc071ab0 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09db7fe700 1 -- 172.21.15.107:0/2570709191 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c40035d0 con 0x7f09dc071ab0 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09dbfff700 1 -- 172.21.15.107:0/2570709191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc15aaa0 msgr2=0x7f09dc13d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09dbfff700 1 --2- 172.21.15.107:0/2570709191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc15aaa0 0x7f09dc13d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09dbfff700 1 -- 172.21.15.107:0/2570709191 >> v1:172.21.15.107:6789/0 conn(0x7f09dc071ab0 legacy=0x7f09dc071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09dbfff700 1 -- 172.21.15.107:0/2570709191 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0cdd10 con 0x7f09dc0ce510 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09dbfff700 1 --2- 172.21.15.107:0/2570709191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc15a560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009850 tx=0x7f09d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7609fae13a47b84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94d959a700 1 -- 172.21.15.107:0/2961825717 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0011830 con 0x7f94dc0cdc20 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94d959a700 1 -- 172.21.15.107:0/2961825717 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0011990 con 0x7f94dc0cdc20 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94d959a700 1 -- 172.21.15.107:0/2961825717 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0011d20 con 0x7f94dc0cdc20 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- 172.21.15.107:0/2961825717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0cdc20 msgr2=0x7f94dc06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 --2- 172.21.15.107:0/2961825717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0cdc20 0x7f94dc06d820 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009850 tx=0x7f94d0009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc532ffd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 0x7fc53406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc533fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc5340ac8e0 0x7fc5340acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc532ffd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 0x7fc53406e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53974/0 (socket says 172.21.15.107:53974) 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc532ffd700 1 -- 172.21.15.107:0/2399453660 learned_addr learned my addr 172.21.15.107:0/2399453660 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc533fff700 1 -- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 msgr2=0x7fc53406e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc533fff700 1 --2- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 0x7fc53406e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc533fff700 1 -- 172.21.15.107:0/2399453660 >> v1:172.21.15.107:6789/0 conn(0x7fc534160c80 legacy=0x7fc534161060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc5327fc700 1 -- 172.21.15.107:0/2399453660 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980175241 0 0) 0x7fc5340b2740 con 0x7fc534160c80 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09db7fe700 1 -- 172.21.15.107:0/2570709191 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000f8a0 con 0x7f09dc0ce510 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09db7fe700 1 -- 172.21.15.107:0/2570709191 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d000fa00 con 0x7f09dc0ce510 2024-05-08T20:56:49.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f09db7fe700 1 -- 172.21.15.107:0/2570709191 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000fdb0 con 0x7f09dc0ce510 2024-05-08T20:56:49.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f065c8f8700 1 Processor -- start 2024-05-08T20:56:49.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc533fff700 1 -- 172.21.15.107:0/2399453660 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340b2460 con 0x7fc5340ac8e0 2024-05-08T20:56:49.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc532ffd700 1 --2- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 0x7fc53406e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:49.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- 172.21.15.107:0/2961825717 shutdown_connections 2024-05-08T20:56:49.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 --2- 172.21.15.107:0/2961825717 >> v2:172.21.15.195:3300/0 conn(0x7f94dc072120 0x7f94dc0ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 --2- 172.21.15.107:0/2961825717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc0cdc20 0x7f94dc06d820 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- 172.21.15.107:0/2961825717 >> 172.21.15.107:0/2961825717 conn(0x7f94dc0aebd0 msgr2=0x7f94dc0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 Processor -- start 2024-05-08T20:56:49.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- 172.21.15.107:0/2961825717 shutdown_connections 2024-05-08T20:56:49.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7fc533fff700 1 --2- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5340acd70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc524009850 tx=0x7fc524009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd2c3ddb92b0eab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f1409e21700 1 -- start start 2024-05-08T20:56:49.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.244+0000 7f94db59e700 1 -- 172.21.15.107:0/2961825717 wait complete. 2024-05-08T20:56:49.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065c8f8700 1 -- start start 2024-05-08T20:56:49.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5327fc700 1 -- 172.21.15.107:0/2399453660 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011830 con 0x7fc5340ac8e0 2024-05-08T20:56:49.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5327fc700 1 -- 172.21.15.107:0/2399453660 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524011990 con 0x7fc5340ac8e0 2024-05-08T20:56:49.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 -- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 msgr2=0x7fc5340acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 --2- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5340acd70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc524009850 tx=0x7fc524009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:49.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 -- 172.21.15.107:0/2399453660 shutdown_connections 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 --2- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5340acd70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 --2- 172.21.15.107:0/2399453660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5340b1f60 0x7fc53406e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 -- 172.21.15.107:0/2399453660 >> 172.21.15.107:0/2399453660 conn(0x7fc5340aebd0 msgr2=0x7fc5340aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 -- 172.21.15.107:0/2399453660 shutdown_connections 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065c8f8700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f065813cda0 0x7f065806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065c8f8700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f065813d180 0x7f065806c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065c8f8700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06580b3380 con 0x7f065815a950 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065c8f8700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065815b6a0 con 0x7f065813d180 2024-05-08T20:56:49.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065c8f8700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580b3660 con 0x7f065813cda0 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f1404169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 0x7f14040899d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140416f0e0 0x7f14040aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404089f10 con 0x7f140416f0e0 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040ac2f0 con 0x7f14040b4cf0 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14040ac5d0 con 0x7f14040b4870 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 0x7f14040899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1408e1f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f1404169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 0x7f14040899d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38780/0 (socket says 172.21.15.107:38780) 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 -- 172.21.15.107:0/956846598 learned_addr learned my addr 172.21.15.107:0/956846598 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 msgr2=0x7f09dc15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 --2- 172.21.15.107:0/2570709191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc15a560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009850 tx=0x7f09d0009b60 comp rx=0 tx=0).stop 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 shutdown_connections 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 --2- 172.21.15.107:0/2570709191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc15aaa0 0x7f09dc13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 --2- 172.21.15.107:0/2570709191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc15a560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 >> 172.21.15.107:0/2570709191 conn(0x7f09dc06c330 msgr2=0x7f09dc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f065813d180 0x7f065806c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f065813d180 0x7f065806c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50772/0 (socket says 172.21.15.107:50772) 2024-05-08T20:56:49.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 -- 172.21.15.107:0/2482191447 learned_addr learned my addr 172.21.15.107:0/2482191447 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065659c700 1 --2- 172.21.15.107:0/2482191447 >> v2:172.21.15.195:3300/0 conn(0x7f065813cda0 0x7f065806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 shutdown_connections 2024-05-08T20:56:49.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f09e1e46700 1 -- 172.21.15.107:0/2570709191 wait complete. 2024-05-08T20:56:49.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409620700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140416f0e0 0x7f14040aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 -- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 msgr2=0x7f1404169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f1404169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 -- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140416f0e0 msgr2=0x7f14040aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140416f0e0 0x7f14040aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 -- 172.21.15.107:0/956846598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc009a70 con 0x7f14040b4cf0 2024-05-08T20:56:49.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 -- 172.21.15.107:0/2482191447 >> v2:172.21.15.195:3300/0 conn(0x7f065813cda0 msgr2=0x7f065806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 --2- 172.21.15.107:0/2482191447 >> v2:172.21.15.195:3300/0 conn(0x7f065813cda0 0x7f065806c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 -- 172.21.15.107:0/2482191447 >> v1:172.21.15.107:6789/0 conn(0x7f065815a950 legacy=0x7f065815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 -- 172.21.15.107:0/2482191447 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580b3940 con 0x7f065813d180 2024-05-08T20:56:49.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f0655d9b700 1 --2- 172.21.15.107:0/2482191447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f065806c890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f065806c110 tx=0x7f0648009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9319d814bfaf68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1403fff700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 0x7f14040899d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13f40090b0 tx=0x7f13f4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 Processor -- start 2024-05-08T20:56:49.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 -- 172.21.15.107:0/2399453660 wait complete. 2024-05-08T20:56:49.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4004480 con 0x7f14040b4cf0 2024-05-08T20:56:49.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4030070 con 0x7f14040b4cf0 2024-05-08T20:56:49.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4003900 con 0x7f14040b4cf0 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 -- start start 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94dc072120 0x7f94dc14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 0x7f94dc0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc15a150 0x7f94dc0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc146640 con 0x7f94dc15a150 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc133690 con 0x7f94dc072120 2024-05-08T20:56:49.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94db59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc133970 con 0x7f94dc0cdc20 2024-05-08T20:56:49.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065559a700 1 -- 172.21.15.107:0/2482191447 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011830 con 0x7f065813d180 2024-05-08T20:56:49.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f065559a700 1 -- 172.21.15.107:0/2482191447 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648011990 con 0x7f065813d180 2024-05-08T20:56:49.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 Processor -- start 2024-05-08T20:56:49.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7fc5389de700 1 -- start start 2024-05-08T20:56:49.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f40094b0 con 0x7f14040b4cf0 2024-05-08T20:56:49.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14040acb90 con 0x7f14040b4cf0 2024-05-08T20:56:49.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 -- 172.21.15.107:0/2482191447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 msgr2=0x7f065806c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 --2- 172.21.15.107:0/2482191447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f065806c890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f065806c110 tx=0x7f0648009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 -- 172.21.15.107:0/2482191447 shutdown_connections 2024-05-08T20:56:49.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 --2- 172.21.15.107:0/2482191447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f065806c890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 --2- 172.21.15.107:0/2482191447 >> v2:172.21.15.195:3300/0 conn(0x7f065813cda0 0x7f065806c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 -- 172.21.15.107:0/2482191447 >> 172.21.15.107:0/2482191447 conn(0x7f065806a360 msgr2=0x7f065806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94da59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94dc072120 0x7f94dc14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94d9d9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 0x7f94dc0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94d9d9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 0x7f94dc0cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:53998/0 (socket says 172.21.15.107:53998) 2024-05-08T20:56:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.248+0000 7f94d9d9b700 1 -- 172.21.15.107:0/1815140091 learned_addr learned my addr 172.21.15.107:0/1815140091 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94d9d9b700 1 -- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94dc072120 msgr2=0x7f94dc14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94d9d9b700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94dc072120 0x7f94dc14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94d9d9b700 1 -- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc15a150 msgr2=0x7f94dc0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94d9d9b700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc15a150 0x7f94dc0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94d9d9b700 1 -- 172.21.15.107:0/1815140091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d00094b0 con 0x7f94dc0cdc20 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5341e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 0x7fc53415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc534160c80 0x7fc534203730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 0x7fc53415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 0x7fc53415d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50798/0 (socket says 172.21.15.107:50798) 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 -- 172.21.15.107:0/2744220393 learned_addr learned my addr 172.21.15.107:0/2744220393 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53415ff70 con 0x7fc5340b1f60 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5341fffe0 con 0x7fc5340ac8e0 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53415f360 con 0x7fc534160c80 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5337fe700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5341e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc533fff700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc534160c80 0x7fc534203730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 -- 172.21.15.107:0/2482191447 shutdown_connections 2024-05-08T20:56:49.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 -- 172.21.15.107:0/2482191447 wait complete. 2024-05-08T20:56:49.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f09e1e46700 1 Processor -- start 2024-05-08T20:56:49.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 -- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc534160c80 msgr2=0x7fc534203730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc534160c80 0x7fc534203730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 -- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 msgr2=0x7fc5341e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5341e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240094b0 con 0x7fc5340b1f60 2024-05-08T20:56:49.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f09e1e46700 1 -- start start 2024-05-08T20:56:49.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1404067b40 con 0x7f14040b4cf0 2024-05-08T20:56:49.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc532ffd700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 0x7fc53415d580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00aeb0 tx=0x7fc52c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f065c8f8700 1 Processor -- start 2024-05-08T20:56:49.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f13f4032030 con 0x7f14040b4cf0 2024-05-08T20:56:49.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00f070 con 0x7fc5340b1f60 2024-05-08T20:56:49.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c00cae0 con 0x7fc5340b1f60 2024-05-08T20:56:49.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53415f640 con 0x7fc5340b1f60 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53415fc00 con 0x7fc5340b1f60 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00ce70 con 0x7fc5340b1f60 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f14017fa700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13f0066870 0x7f13f0068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13f4096be0 con 0x7f14040b4cf0 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f1408e1f700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13f0066870 0x7f13f0068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f1408e1f700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13f0066870 0x7f13f0068d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13ec005930 tx=0x7f13ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94d9d9b700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 0x7f94dc0cc8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94d400b9e0 tx=0x7f94d400bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d400ca30 con 0x7f94dc0cdc20 2024-05-08T20:56:49.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc133c50 con 0x7f94dc0cdc20 2024-05-08T20:56:49.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc134210 con 0x7f94dc0cdc20 2024-05-08T20:56:49.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d400cbb0 con 0x7f94dc0cdc20 2024-05-08T20:56:49.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.252+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4014440 con 0x7f94dc0cdc20 2024-05-08T20:56:49.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 -- start start 2024-05-08T20:56:49.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94d401d3b0 con 0x7f94dc0cdc20 2024-05-08T20:56:49.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1e46700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc071ab0 0x7f09dc134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1e46700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f94caffd700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f94bc066730 0x7f94bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc1535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50806/0 (socket says 172.21.15.107:50806) 2024-05-08T20:56:49.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1e46700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09dc15aaa0 0x7f09dc06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e0e44700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc071ab0 0x7f09dc134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 -- 172.21.15.107:0/2724023411 learned_addr learned my addr 172.21.15.107:0/2724023411 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1e46700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc138e60 con 0x7f09dc0ce510 2024-05-08T20:56:49.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1e46700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc135350 con 0x7f09dc15aaa0 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1e46700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc138250 con 0x7f09dc071ab0 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f94da59c700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f94bc066730 0x7f94bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065813cda0 0x7f0658071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f0658138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065815a950 0x7f06580af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580b0260 con 0x7f065813d180 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06580afb40 con 0x7f065815a950 2024-05-08T20:56:49.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06580afe10 con 0x7f065813cda0 2024-05-08T20:56:49.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 -- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc071ab0 msgr2=0x7f09dc134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc071ab0 0x7f09dc134e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1645700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09dc15aaa0 0x7f09dc06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 -- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09dc15aaa0 msgr2=0x7f09dc06ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09dc15aaa0 0x7f09dc06ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00094b0 con 0x7f09dc0ce510 2024-05-08T20:56:49.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09e1645700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09dc15aaa0 0x7f09dc06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:49.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f0658138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f0658138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50818/0 (socket says 172.21.15.107:50818) 2024-05-08T20:56:49.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 -- 172.21.15.107:0/4197893085 learned_addr learned my addr 172.21.15.107:0/4197893085 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f09dbfff700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc1535d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09d00090b0 tx=0x7f09d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f94da59c700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f94bc066730 0x7f94bc068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009fd0 tx=0x7f94d0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc52c01d460 con 0x7fc5340b1f60 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065659c700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065813cda0 0x7f0658071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0656d9d700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065815a950 0x7f06580af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 -- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065813cda0 msgr2=0x7f0658071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065813cda0 0x7f0658071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 -- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065815a950 msgr2=0x7f06580af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065815a950 0x7f06580af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 -- 172.21.15.107:0/4197893085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0648009570 con 0x7f065813d180 2024-05-08T20:56:49.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0656d9d700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065815a950 0x7f06580af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:49.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94d4083d30 con 0x7f94dc0cdc20 2024-05-08T20:56:49.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0655d9b700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f0658138070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0658074490 tx=0x7f0648004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514005310 con 0x7fc5340b1f60 2024-05-08T20:56:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648003ad0 con 0x7f065813d180 2024-05-08T20:56:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648003c50 con 0x7f065813d180 2024-05-08T20:56:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06580b04b0 con 0x7f065813d180 2024-05-08T20:56:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06580b0a70 con 0x7f065813d180 2024-05-08T20:56:49.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480045d0 con 0x7f065813d180 2024-05-08T20:56:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7fc51bfff700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc520066830 0x7fc520068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc52c084790 con 0x7fc5340b1f60 2024-05-08T20:56:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7fc5337fe700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc520066830 0x7fc520068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.256+0000 7fc5337fe700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc520066830 0x7fc520068cf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc528000f60 tx=0x7fc528009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d00038c0 con 0x7f09dc0ce510 2024-05-08T20:56:49.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d0004600 con 0x7f09dc0ce510 2024-05-08T20:56:49.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0003c60 con 0x7f09dc0ce510 2024-05-08T20:56:49.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7f09e1e46700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc138530 con 0x7f09dc0ce510 2024-05-08T20:56:49.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7f09e1e46700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc138af0 con 0x7f09dc0ce510 2024-05-08T20:56:49.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f13f4064100 con 0x7f14040b4cf0 2024-05-08T20:56:49.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.260+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc52c051ae0 con 0x7fc5340b1f60 2024-05-08T20:56:49.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c005310 con 0x7f065813d180 2024-05-08T20:56:49.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c0005310 con 0x7f94dc0cdc20 2024-05-08T20:56:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09d00204d0 con 0x7f09dc0ce510 2024-05-08T20:56:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f09d97fa700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f09c4066c10 0x7f09c40690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09d0088cd0 con 0x7f09dc0ce510 2024-05-08T20:56:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f09e0e44700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f09c4066c10 0x7f09c40690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.264+0000 7f09e0e44700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f09c4066c10 0x7f09c40690d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f09cc007fd0 tx=0x7f09cc007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.268+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc005310 con 0x7f09dc0ce510 2024-05-08T20:56:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.268+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0648011930 con 0x7f065813d180 2024-05-08T20:56:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.268+0000 7f0646ffd700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0638066730 0x7f0638068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.268+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0648085620 con 0x7f065813d180 2024-05-08T20:56:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.268+0000 7f065659c700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0638066730 0x7f0638068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.268+0000 7f065659c700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0638066730 0x7f0638068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f064c009b00 tx=0x7f064c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.272+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f94d4051160 con 0x7f94dc0cdc20 2024-05-08T20:56:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.272+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f09d00561b0 con 0x7f09dc0ce510 2024-05-08T20:56:49.300 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.284+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0648052c00 con 0x7f065813d180 2024-05-08T20:56:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.524+0000 7f3c06e37700 1 -- 172.21.15.107:0/3402943108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3c000723d0 con 0x7f3c000b1f60 2024-05-08T20:56:49.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.524+0000 7f3bfd7fa700 1 -- 172.21.15.107:0/3402943108 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3bf401e090 con 0x7f3c000b1f60 2024-05-08T20:56:49.533 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 -- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3bec066780 msgr2=0x7f3bec068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3bec066780 0x7f3bec068c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0000c00 tx=0x7f3bf0014000 comp rx=0 tx=0).stop 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 -- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 msgr2=0x7f3c00158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 0x7f3c00158bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400c7c0 tx=0x7f3bf400cad0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 -- 172.21.15.107:0/3402943108 shutdown_connections 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3bec066780 0x7f3bec068c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3c0013f460 0x7f3c001fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3c000cdc20 0x7f3c0013ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 --2- 172.21.15.107:0/3402943108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c000b1f60 0x7f3c00158bd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 -- 172.21.15.107:0/3402943108 >> 172.21.15.107:0/3402943108 conn(0x7f3c000aebd0 msgr2=0x7f3c0015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 -- 172.21.15.107:0/3402943108 shutdown_connections 2024-05-08T20:56:49.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.528+0000 7f3be6ffd700 1 -- 172.21.15.107:0/3402943108 wait complete. 2024-05-08T20:56:49.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.532+0000 7fb862e5f700 1 -- 172.21.15.107:0/1019910899 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb85c1e5820 con 0x7fb85c158640 2024-05-08T20:56:49.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.532+0000 7fb8597fa700 1 -- 172.21.15.107:0/1019910899 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb85c1e5820 con 0x7fb85c158640 2024-05-08T20:56:49.541 INFO:teuthology.orchestra.run.smithi107.stdout:55834574855 2024-05-08T20:56:49.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe570005890 con 0x7fe59006d820 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 -- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8480667b0 msgr2=0x7fb848068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8480667b0 0x7fb848068c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d690 tx=0x7fb854012000 comp rx=0 tx=0).stop 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 -- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 msgr2=0x7fb85c1e3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 0x7fb85c1e3d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c410 tx=0x7fb84c00c720 comp rx=0 tx=0).stop 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 -- 172.21.15.107:0/1019910899 shutdown_connections 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb85c158640 0x7fb85c1e3d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb8480667b0 0x7fb848068c70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb85c0ce000 0x7fb85c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 --2- 172.21.15.107:0/1019910899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb85c0b1f60 0x7fb85c202400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 -- 172.21.15.107:0/1019910899 >> 172.21.15.107:0/1019910899 conn(0x7fb85c0aebd0 msgr2=0x7fb85c0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 -- 172.21.15.107:0/1019910899 shutdown_connections 2024-05-08T20:56:49.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fb842ffd700 1 -- 172.21.15.107:0/1019910899 wait complete. 2024-05-08T20:56:49.548 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.540+0000 7fe577fff700 1 -- 172.21.15.107:0/3378182539 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe580032db0 con 0x7fe59006d820 2024-05-08T20:56:49.548 INFO:teuthology.orchestra.run.smithi107.stdout:55834574855 2024-05-08T20:56:49.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-05-08T20:56:49.555 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe57c066730 msgr2=0x7fe57c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe57c066730 0x7fe57c068bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe590143e10 tx=0x7fe584009190 comp rx=0 tx=0).stop 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 msgr2=0x7fe5901ee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 0x7fe5901ee0d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe58002e660 tx=0x7fe58002e970 comp rx=0 tx=0).stop 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 shutdown_connections 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe57c066730 0x7fe57c068bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe5900cdc20 0x7fe590156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5900b1f60 0x7fe590156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 --2- 172.21.15.107:0/3378182539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe59006d820 0x7fe5901ee0d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 >> 172.21.15.107:0/3378182539 conn(0x7fe5900aebd0 msgr2=0x7fe590071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 shutdown_connections 2024-05-08T20:56:49.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.548+0000 7fe595db2700 1 -- 172.21.15.107:0/3378182539 wait complete. 2024-05-08T20:56:49.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-08T20:56:49.562 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-05-08T20:56:49.567 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.568+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f94c0005890 con 0x7f94dc0cdc20 2024-05-08T20:56:49.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.568+0000 7f94caffd700 1 -- 172.21.15.107:0/1815140091 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94d4019030 con 0x7f94dc0cdc20 2024-05-08T20:56:49.577 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:49.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f14040684b0 con 0x7f14040b4cf0 2024-05-08T20:56:49.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f94bc066730 msgr2=0x7f94bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f94bc066730 0x7f94bc068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009fd0 tx=0x7f94d0008030 comp rx=0 tx=0).stop 2024-05-08T20:56:49.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 msgr2=0x7f94dc0cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 0x7f94dc0cc8a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94d400b9e0 tx=0x7f94d400bda0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 shutdown_connections 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94dc15a150 0x7f94dc0ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f94bc066730 0x7f94bc068bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f94dc0cdc20 0x7f94dc0cc8a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 --2- 172.21.15.107:0/1815140091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f94dc072120 0x7f94dc14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 >> 172.21.15.107:0/1815140091 conn(0x7f94dc0aebd0 msgr2=0x7f94dc071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f14017fa700 1 -- 172.21.15.107:0/956846598 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13f4067720 con 0x7f14040b4cf0 2024-05-08T20:56:49.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 shutdown_connections 2024-05-08T20:56:49.581 INFO:teuthology.orchestra.run.smithi107.stdout:55834574855 2024-05-08T20:56:49.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f94db59e700 1 -- 172.21.15.107:0/1815140091 wait complete. 2024-05-08T20:56:49.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13f0066870 msgr2=0x7f13f0068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13f0066870 0x7f13f0068d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13ec005930 tx=0x7f13ec009040 comp rx=0 tx=0).stop 2024-05-08T20:56:49.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 msgr2=0x7f14040899d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 0x7f14040899d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f13f40090b0 tx=0x7f13f4004770 comp rx=0 tx=0).stop 2024-05-08T20:56:49.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 shutdown_connections 2024-05-08T20:56:49.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f140416f0e0 0x7f14040aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14040b4cf0 0x7f14040899d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13f0066870 0x7f13f0068d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 --2- 172.21.15.107:0/956846598 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14040b4870 0x7f1404169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 >> 172.21.15.107:0/956846598 conn(0x7f14040aebd0 msgr2=0x7f140416bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.572+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 shutdown_connections 2024-05-08T20:56:49.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.576+0000 7f1409e21700 1 -- 172.21.15.107:0/956846598 wait complete. 2024-05-08T20:56:49.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.580+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5140055c0 con 0x7fc5340b1f60 2024-05-08T20:56:49.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.580+0000 7fc51bfff700 1 -- 172.21.15.107:0/2744220393 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc52c055100 con 0x7fc5340b1f60 2024-05-08T20:56:49.588 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:49.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc520066830 msgr2=0x7fc520068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc520066830 0x7fc520068cf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc528000f60 tx=0x7fc528009040 comp rx=0 tx=0).stop 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 msgr2=0x7fc53415d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 0x7fc53415d580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00aeb0 tx=0x7fc52c00c330 comp rx=0 tx=0).stop 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 shutdown_connections 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc520066830 0x7fc520068cf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc534160c80 0x7fc534203730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5340b1f60 0x7fc53415d580 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 --2- 172.21.15.107:0/2744220393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5340ac8e0 0x7fc5341e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 >> 172.21.15.107:0/2744220393 conn(0x7fc5340aebd0 msgr2=0x7fc534137d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 shutdown_connections 2024-05-08T20:56:49.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.584+0000 7fc5389de700 1 -- 172.21.15.107:0/2744220393 wait complete. 2024-05-08T20:56:49.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-08T20:56:49.593 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-08T20:56:49.596 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.588+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f09bc005890 con 0x7f09dc0ce510 2024-05-08T20:56:49.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09d97fa700 1 -- 172.21.15.107:0/2724023411 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09d0026020 con 0x7f09dc0ce510 2024-05-08T20:56:49.598 INFO:teuthology.orchestra.run.smithi107.stdout:55834574854 2024-05-08T20:56:49.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-05-08T20:56:49.601 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f09c4066c10 msgr2=0x7f09c40690d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f09c4066c10 0x7f09c40690d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f09cc007fd0 tx=0x7f09cc007de0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 msgr2=0x7f09dc1535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc1535d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09d00090b0 tx=0x7f09d0004770 comp rx=0 tx=0).stop 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 shutdown_connections 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f09dc15aaa0 0x7f09dc06ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f09dc0ce510 0x7f09dc1535d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f09c4066c10 0x7f09c40690d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 --2- 172.21.15.107:0/2724023411 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f09dc071ab0 0x7f09dc134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 >> 172.21.15.107:0/2724023411 conn(0x7f09dc06c330 msgr2=0x7f09dc06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 shutdown_connections 2024-05-08T20:56:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.592+0000 7f09c2ffd700 1 -- 172.21.15.107:0/2724023411 wait complete. 2024-05-08T20:56:49.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.600+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f063c005890 con 0x7f065813d180 2024-05-08T20:56:49.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.600+0000 7f0646ffd700 1 -- 172.21.15.107:0/4197893085 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0648056220 con 0x7f065813d180 2024-05-08T20:56:49.608 INFO:teuthology.orchestra.run.smithi107.stdout:55834574853 2024-05-08T20:56:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0638066730 msgr2=0x7f0638068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0638066730 0x7f0638068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f064c009b00 tx=0x7f064c008040 comp rx=0 tx=0).stop 2024-05-08T20:56:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 msgr2=0x7f0658138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f0658138070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0658074490 tx=0x7f0648004770 comp rx=0 tx=0).stop 2024-05-08T20:56:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 shutdown_connections 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f065815a950 0x7f06580af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f065813d180 0x7f0658138070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0638066730 0x7f0638068bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 --2- 172.21.15.107:0/4197893085 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f065813cda0 0x7f0658071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 >> 172.21.15.107:0/4197893085 conn(0x7f065806a360 msgr2=0x7f065815d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 shutdown_connections 2024-05-08T20:56:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.604+0000 7f065c8f8700 1 -- 172.21.15.107:0/4197893085 wait complete. 2024-05-08T20:56:49.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-05-08T20:56:49.614 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-05-08T20:56:49.621 DEBUG:teuthology.parallel:result is None 2024-05-08T20:56:49.621 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T20:56:49.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 Processor -- start 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- start start 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f07d80b3c20 0x7f07d81624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d80705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d8158960 con 0x7f07d8071e70 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d80b1f60 con 0x7f07d80b3c20 2024-05-08T20:56:49.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d80ae990 con 0x7f07d8070110 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d80705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d80705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:54022/0 (socket says 172.21.15.107:54022) 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dda64700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f07d80b3c20 0x7f07d81624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 -- 172.21.15.107:0/2795979009 learned_addr learned my addr 172.21.15.107:0/2795979009 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dca62700 1 -- 172.21.15.107:0/2795979009 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779147427 0 0) 0x7f07d8158960 con 0x7f07d8071e70 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dca62700 1 -- 172.21.15.107:0/2795979009 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c40035d0 con 0x7f07d8071e70 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 -- 172.21.15.107:0/2795979009 >> v2:172.21.15.195:3300/0 conn(0x7f07d80b3c20 msgr2=0x7f07d81624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 --2- 172.21.15.107:0/2795979009 >> v2:172.21.15.195:3300/0 conn(0x7f07d80b3c20 0x7f07d81624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 -- 172.21.15.107:0/2795979009 >> v1:172.21.15.195:6789/0 conn(0x7f07d8071e70 legacy=0x7f07d80b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 -- 172.21.15.107:0/2795979009 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80b2170 con 0x7f07d8070110 2024-05-08T20:56:49.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07de265700 1 --2- 172.21.15.107:0/2795979009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d80705a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009e50 tx=0x7f07d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5032813d06bceb7e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dca62700 1 -- 172.21.15.107:0/2795979009 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d000e070 con 0x7f07d8070110 2024-05-08T20:56:49.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dca62700 1 -- 172.21.15.107:0/2795979009 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d000b910 con 0x7f07d8070110 2024-05-08T20:56:49.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dca62700 1 -- 172.21.15.107:0/2795979009 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d000bcc0 con 0x7f07d8070110 2024-05-08T20:56:49.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- 172.21.15.107:0/2795979009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 msgr2=0x7f07d80705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 --2- 172.21.15.107:0/2795979009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d80705a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009e50 tx=0x7f07d000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:49.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- 172.21.15.107:0/2795979009 shutdown_connections 2024-05-08T20:56:49.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 --2- 172.21.15.107:0/2795979009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d80705a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 --2- 172.21.15.107:0/2795979009 >> v2:172.21.15.195:3300/0 conn(0x7f07d80b3c20 0x7f07d81624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- 172.21.15.107:0/2795979009 >> 172.21.15.107:0/2795979009 conn(0x7f07d806c330 msgr2=0x7f07d806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- 172.21.15.107:0/2795979009 shutdown_connections 2024-05-08T20:56:49.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.716+0000 7f07dea66700 1 -- 172.21.15.107:0/2795979009 wait complete. 2024-05-08T20:56:49.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 Processor -- start 2024-05-08T20:56:49.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 -- start start 2024-05-08T20:56:49.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d81ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 0x7f07d81f8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d80b3c20 0x7f07d8158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81e9500 con 0x7f07d8071e70 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81ec7e0 con 0x7f07d80b3c20 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d81e9750 con 0x7f07d8070110 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 0x7f07d81f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 0x7f07d81f8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50826/0 (socket says 172.21.15.107:50826) 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 -- 172.21.15.107:0/1410375891 learned_addr learned my addr 172.21.15.107:0/1410375891 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dda64700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d81ec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07de265700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d80b3c20 0x7f07d8158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 -- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 msgr2=0x7f07d81ec0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d81ec0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 -- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d80b3c20 msgr2=0x7f07d8158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d80b3c20 0x7f07d8158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 -- 172.21.15.107:0/1410375891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009b30 con 0x7f07d8071e70 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07de265700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d80b3c20 0x7f07d8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dd263700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 0x7f07d81f8350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c500 tx=0x7f07d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40052d0 con 0x7f07d8071e70 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4005450 con 0x7f07d8071e70 2024-05-08T20:56:49.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d81e9a30 con 0x7f07d8071e70 2024-05-08T20:56:49.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40038e0 con 0x7f07d8071e70 2024-05-08T20:56:49.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.720+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d81f89d0 con 0x7f07d8071e70 2024-05-08T20:56:49.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.724+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d81e9f50 con 0x7f07d8071e70 2024-05-08T20:56:49.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.724+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07d4003a40 con 0x7f07d8071e70 2024-05-08T20:56:49.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.724+0000 7f07ce7fc700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07bc066760 0x7f07bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:49.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.724+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07d4083760 con 0x7f07d8071e70 2024-05-08T20:56:49.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.724+0000 7f07dda64700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07bc066760 0x7f07bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:49.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.724+0000 7f07dda64700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07bc066760 0x7f07bc068c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009ae0 tx=0x7f07c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:49.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.728+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f07d4050c40 con 0x7f07d8071e70 2024-05-08T20:56:49.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.888+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07d80b2a10 con 0x7f07bc066760 2024-05-08T20:56:49.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.896+0000 7f07ce7fc700 1 -- 172.21.15.107:0/1410375891 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264462 (secure 0 0 0) 0x7f07c8011750 con 0x7f07bc066760 2024-05-08T20:56:49.909 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:49.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07bc066760 msgr2=0x7f07bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07bc066760 0x7f07bc068c20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009ae0 tx=0x7f07c8008040 comp rx=0 tx=0).stop 2024-05-08T20:56:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 msgr2=0x7f07d81f8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 0x7f07d81f8350 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c500 tx=0x7f07d400c8c0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 shutdown_connections 2024-05-08T20:56:49.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07d80b3c20 0x7f07d8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07d8071e70 0x7f07d81f8350 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07bc066760 0x7f07bc068c20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 --2- 172.21.15.107:0/1410375891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07d8070110 0x7f07d81ec0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 >> 172.21.15.107:0/1410375891 conn(0x7f07d806c330 msgr2=0x7f07d80ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 shutdown_connections 2024-05-08T20:56:49.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:49.900+0000 7f07dea66700 1 -- 172.21.15.107:0/1410375891 wait complete. 2024-05-08T20:56:49.916 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T20:56:49.921 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-08T20:56:48.698742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235408,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739312,"statfs":{"total":773094113280,"available":772853055488,"internally_reserved":0,"allocated":2887680,"data_stored":1751625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":238014010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.307886"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273716+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T20:56:43.273716+0000","last_peered":"2024-05-08T20:56:43.273716+0000","last_clean":"2024-05-08T20:56:43.273716+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T20:56:43.273716+0000","last_undegraded":"2024-05-08T20:56:43.273716+0000","last_fullsized":"2024-05-08T20:56:43.273716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786417+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T20:56:42.786417+0000","last_peered":"2024-05-08T20:56:42.786417+0000","last_clean":"2024-05-08T20:56:42.786417+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T20:56:42.786417+0000","last_undegraded":"2024-05-08T20:56:42.786417+0000","last_fullsized":"2024-05-08T20:56:42.786417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273684+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T20:56:43.273684+0000","last_peered":"2024-05-08T20:56:43.273684+0000","last_clean":"2024-05-08T20:56:43.273684+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T20:56:43.273684+0000","last_undegraded":"2024-05-08T20:56:43.273684+0000","last_fullsized":"2024-05-08T20:56:43.273684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786779+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T20:56:42.786779+0000","last_peered":"2024-05-08T20:56:42.786779+0000","last_clean":"2024-05-08T20:56:42.786779+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T20:56:42.786779+0000","last_undegraded":"2024-05-08T20:56:42.786779+0000","last_fullsized":"2024-05-08T20:56:42.786779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273146+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T20:56:43.273146+0000","last_peered":"2024-05-08T20:56:43.273146+0000","last_clean":"2024-05-08T20:56:43.273146+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T20:56:43.273146+0000","last_undegraded":"2024-05-08T20:56:43.273146+0000","last_fullsized":"2024-05-08T20:56:43.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786495+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T20:56:42.786495+0000","last_peered":"2024-05-08T20:56:42.786495+0000","last_clean":"2024-05-08T20:56:42.786495+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T20:56:42.786495+0000","last_undegraded":"2024-05-08T20:56:42.786495+0000","last_fullsized":"2024-05-08T20:56:42.786495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272601+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T20:56:43.272601+0000","last_peered":"2024-05-08T20:56:43.272601+0000","last_clean":"2024-05-08T20:56:43.272601+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T20:56:43.272601+0000","last_undegraded":"2024-05-08T20:56:43.272601+0000","last_fullsized":"2024-05-08T20:56:43.272601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273717+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T20:56:43.273717+0000","last_peered":"2024-05-08T20:56:43.273717+0000","last_clean":"2024-05-08T20:56:43.273717+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T20:56:43.273717+0000","last_undegraded":"2024-05-08T20:56:43.273717+0000","last_fullsized":"2024-05-08T20:56:43.273717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043718+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T20:56:43.043718+0000","last_peered":"2024-05-08T20:56:43.043718+0000","last_clean":"2024-05-08T20:56:43.043718+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T20:56:43.043718+0000","last_undegraded":"2024-05-08T20:56:43.043718+0000","last_fullsized":"2024-05-08T20:56:43.043718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043303+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T20:56:43.043303+0000","last_peered":"2024-05-08T20:56:43.043303+0000","last_clean":"2024-05-08T20:56:43.043303+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T20:56:43.043303+0000","last_undegraded":"2024-05-08T20:56:43.043303+0000","last_fullsized":"2024-05-08T20:56:43.043303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788169+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T20:56:42.788169+0000","last_peered":"2024-05-08T20:56:42.788169+0000","last_clean":"2024-05-08T20:56:42.788169+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T20:56:42.788169+0000","last_undegraded":"2024-05-08T20:56:42.788169+0000","last_fullsized":"2024-05-08T20:56:42.788169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274034+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T20:56:43.274034+0000","last_peered":"2024-05-08T20:56:43.274034+0000","last_clean":"2024-05-08T20:56:43.274034+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T20:56:43.274034+0000","last_undegraded":"2024-05-08T20:56:43.274034+0000","last_fullsized":"2024-05-08T20:56:43.274034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273554+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T20:56:43.273554+0000","last_peered":"2024-05-08T20:56:43.273554+0000","last_clean":"2024-05-08T20:56:43.273554+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T20:56:43.273554+0000","last_undegraded":"2024-05-08T20:56:43.273554+0000","last_fullsized":"2024-05-08T20:56:43.273554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785960+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T20:56:42.785960+0000","last_peered":"2024-05-08T20:56:42.785960+0000","last_clean":"2024-05-08T20:56:42.785960+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T20:56:42.785960+0000","last_undegraded":"2024-05-08T20:56:42.785960+0000","last_fullsized":"2024-05-08T20:56:42.785960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786454+0000","last_change":"2024-05-08T20:56:41.791132+0000","last_active":"2024-05-08T20:56:42.786454+0000","last_peered":"2024-05-08T20:56:42.786454+0000","last_clean":"2024-05-08T20:56:42.786454+0000","last_became_active":"2024-05-08T20:56:41.790838+0000","last_became_peered":"2024-05-08T20:56:41.790838+0000","last_unstale":"2024-05-08T20:56:42.786454+0000","last_undegraded":"2024-05-08T20:56:42.786454+0000","last_fullsized":"2024-05-08T20:56:42.786454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787321+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T20:56:42.787321+0000","last_peered":"2024-05-08T20:56:42.787321+0000","last_clean":"2024-05-08T20:56:42.787321+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T20:56:42.787321+0000","last_undegraded":"2024-05-08T20:56:42.787321+0000","last_fullsized":"2024-05-08T20:56:42.787321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793458+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T20:56:42.793458+0000","last_peered":"2024-05-08T20:56:42.793458+0000","last_clean":"2024-05-08T20:56:42.793458+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T20:56:42.793458+0000","last_undegraded":"2024-05-08T20:56:42.793458+0000","last_fullsized":"2024-05-08T20:56:42.793458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273673+0000","last_change":"2024-05-08T20:56:41.802323+0000","last_active":"2024-05-08T20:56:43.273673+0000","last_peered":"2024-05-08T20:56:43.273673+0000","last_clean":"2024-05-08T20:56:43.273673+0000","last_became_active":"2024-05-08T20:56:41.798890+0000","last_became_peered":"2024-05-08T20:56:41.798890+0000","last_unstale":"2024-05-08T20:56:43.273673+0000","last_undegraded":"2024-05-08T20:56:43.273673+0000","last_fullsized":"2024-05-08T20:56:43.273673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043301+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.043301+0000","last_peered":"2024-05-08T20:56:43.043301+0000","last_clean":"2024-05-08T20:56:43.043301+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.043301+0000","last_undegraded":"2024-05-08T20:56:43.043301+0000","last_fullsized":"2024-05-08T20:56:43.043301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273478+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T20:56:43.273478+0000","last_peered":"2024-05-08T20:56:43.273478+0000","last_clean":"2024-05-08T20:56:43.273478+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T20:56:43.273478+0000","last_undegraded":"2024-05-08T20:56:43.273478+0000","last_fullsized":"2024-05-08T20:56:43.273478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786653+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T20:56:42.786653+0000","last_peered":"2024-05-08T20:56:42.786653+0000","last_clean":"2024-05-08T20:56:42.786653+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T20:56:42.786653+0000","last_undegraded":"2024-05-08T20:56:42.786653+0000","last_fullsized":"2024-05-08T20:56:42.786653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272750+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T20:56:43.272750+0000","last_peered":"2024-05-08T20:56:43.272750+0000","last_clean":"2024-05-08T20:56:43.272750+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T20:56:43.272750+0000","last_undegraded":"2024-05-08T20:56:43.272750+0000","last_fullsized":"2024-05-08T20:56:43.272750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786490+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T20:56:42.786490+0000","last_peered":"2024-05-08T20:56:42.786490+0000","last_clean":"2024-05-08T20:56:42.786490+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T20:56:42.786490+0000","last_undegraded":"2024-05-08T20:56:42.786490+0000","last_fullsized":"2024-05-08T20:56:42.786490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274272+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T20:56:43.274272+0000","last_peered":"2024-05-08T20:56:43.274272+0000","last_clean":"2024-05-08T20:56:43.274272+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T20:56:43.274272+0000","last_undegraded":"2024-05-08T20:56:43.274272+0000","last_fullsized":"2024-05-08T20:56:43.274272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043789+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T20:56:43.043789+0000","last_peered":"2024-05-08T20:56:43.043789+0000","last_clean":"2024-05-08T20:56:43.043789+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T20:56:43.043789+0000","last_undegraded":"2024-05-08T20:56:43.043789+0000","last_fullsized":"2024-05-08T20:56:43.043789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786283+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T20:56:42.786283+0000","last_peered":"2024-05-08T20:56:42.786283+0000","last_clean":"2024-05-08T20:56:42.786283+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T20:56:42.786283+0000","last_undegraded":"2024-05-08T20:56:42.786283+0000","last_fullsized":"2024-05-08T20:56:42.786283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274673+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.274673+0000","last_peered":"2024-05-08T20:56:43.274673+0000","last_clean":"2024-05-08T20:56:43.274673+0000","last_became_active":"2024-05-08T20:56:41.810632+0000","last_became_peered":"2024-05-08T20:56:41.810632+0000","last_unstale":"2024-05-08T20:56:43.274673+0000","last_undegraded":"2024-05-08T20:56:43.274673+0000","last_fullsized":"2024-05-08T20:56:43.274673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273719+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T20:56:43.273719+0000","last_peered":"2024-05-08T20:56:43.273719+0000","last_clean":"2024-05-08T20:56:43.273719+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T20:56:43.273719+0000","last_undegraded":"2024-05-08T20:56:43.273719+0000","last_fullsized":"2024-05-08T20:56:43.273719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787815+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T20:56:42.787815+0000","last_peered":"2024-05-08T20:56:42.787815+0000","last_clean":"2024-05-08T20:56:42.787815+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T20:56:42.787815+0000","last_undegraded":"2024-05-08T20:56:42.787815+0000","last_fullsized":"2024-05-08T20:56:42.787815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793490+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T20:56:42.793490+0000","last_peered":"2024-05-08T20:56:42.793490+0000","last_clean":"2024-05-08T20:56:42.793490+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T20:56:42.793490+0000","last_undegraded":"2024-05-08T20:56:42.793490+0000","last_fullsized":"2024-05-08T20:56:42.793490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042896+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T20:56:43.042896+0000","last_peered":"2024-05-08T20:56:43.042896+0000","last_clean":"2024-05-08T20:56:43.042896+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T20:56:43.042896+0000","last_undegraded":"2024-05-08T20:56:43.042896+0000","last_fullsized":"2024-05-08T20:56:43.042896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787032+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T20:56:42.787032+0000","last_peered":"2024-05-08T20:56:42.787032+0000","last_clean":"2024-05-08T20:56:42.787032+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T20:56:42.787032+0000","last_undegraded":"2024-05-08T20:56:42.787032+0000","last_fullsized":"2024-05-08T20:56:42.787032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274508+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:56:43.274508+0000","last_peered":"2024-05-08T20:56:43.274508+0000","last_clean":"2024-05-08T20:56:43.274508+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:56:43.274508+0000","last_undegraded":"2024-05-08T20:56:43.274508+0000","last_fullsized":"2024-05-08T20:56:43.274508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043109+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:56:43.043109+0000","last_peered":"2024-05-08T20:56:43.043109+0000","last_clean":"2024-05-08T20:56:43.043109+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:56:43.043109+0000","last_undegraded":"2024-05-08T20:56:43.043109+0000","last_fullsized":"2024-05-08T20:56:43.043109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273264+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:56:43.273264+0000","last_peered":"2024-05-08T20:56:43.273264+0000","last_clean":"2024-05-08T20:56:43.273264+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:56:43.273264+0000","last_undegraded":"2024-05-08T20:56:43.273264+0000","last_fullsized":"2024-05-08T20:56:43.273264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272849+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T20:56:43.272849+0000","last_peered":"2024-05-08T20:56:43.272849+0000","last_clean":"2024-05-08T20:56:43.272849+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T20:56:43.272849+0000","last_undegraded":"2024-05-08T20:56:43.272849+0000","last_fullsized":"2024-05-08T20:56:43.272849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:56:42.786560+0000","last_peered":"2024-05-08T20:56:42.786560+0000","last_clean":"2024-05-08T20:56:42.786560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:56:42.786560+0000","last_undegraded":"2024-05-08T20:56:42.786560+0000","last_fullsized":"2024-05-08T20:56:42.786560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785898+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T20:56:42.785898+0000","last_peered":"2024-05-08T20:56:42.785898+0000","last_clean":"2024-05-08T20:56:42.785898+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T20:56:42.785898+0000","last_undegraded":"2024-05-08T20:56:42.785898+0000","last_fullsized":"2024-05-08T20:56:42.785898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043678+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:56:43.043678+0000","last_peered":"2024-05-08T20:56:43.043678+0000","last_clean":"2024-05-08T20:56:43.043678+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:56:43.043678+0000","last_undegraded":"2024-05-08T20:56:43.043678+0000","last_fullsized":"2024-05-08T20:56:43.043678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787265+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T20:56:42.787265+0000","last_peered":"2024-05-08T20:56:42.787265+0000","last_clean":"2024-05-08T20:56:42.787265+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T20:56:42.787265+0000","last_undegraded":"2024-05-08T20:56:42.787265+0000","last_fullsized":"2024-05-08T20:56:42.787265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787227+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:56:42.787227+0000","last_peered":"2024-05-08T20:56:42.787227+0000","last_clean":"2024-05-08T20:56:42.787227+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:56:42.787227+0000","last_undegraded":"2024-05-08T20:56:42.787227+0000","last_fullsized":"2024-05-08T20:56:42.787227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273777+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T20:56:43.273777+0000","last_peered":"2024-05-08T20:56:43.273777+0000","last_clean":"2024-05-08T20:56:43.273777+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T20:56:43.273777+0000","last_undegraded":"2024-05-08T20:56:43.273777+0000","last_fullsized":"2024-05-08T20:56:43.273777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786449+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T20:56:42.786449+0000","last_peered":"2024-05-08T20:56:42.786449+0000","last_clean":"2024-05-08T20:56:42.786449+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T20:56:42.786449+0000","last_undegraded":"2024-05-08T20:56:42.786449+0000","last_fullsized":"2024-05-08T20:56:42.786449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788239+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T20:56:42.788239+0000","last_peered":"2024-05-08T20:56:42.788239+0000","last_clean":"2024-05-08T20:56:42.788239+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T20:56:42.788239+0000","last_undegraded":"2024-05-08T20:56:42.788239+0000","last_fullsized":"2024-05-08T20:56:42.788239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043359+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:56:43.043359+0000","last_peered":"2024-05-08T20:56:43.043359+0000","last_clean":"2024-05-08T20:56:43.043359+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:56:43.043359+0000","last_undegraded":"2024-05-08T20:56:43.043359+0000","last_fullsized":"2024-05-08T20:56:43.043359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273305+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T20:56:43.273305+0000","last_peered":"2024-05-08T20:56:43.273305+0000","last_clean":"2024-05-08T20:56:43.273305+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T20:56:43.273305+0000","last_undegraded":"2024-05-08T20:56:43.273305+0000","last_fullsized":"2024-05-08T20:56:43.273305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273945+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:56:43.273945+0000","last_peered":"2024-05-08T20:56:43.273945+0000","last_clean":"2024-05-08T20:56:43.273945+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:56:43.273945+0000","last_undegraded":"2024-05-08T20:56:43.273945+0000","last_fullsized":"2024-05-08T20:56:43.273945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273114+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T20:56:43.273114+0000","last_peered":"2024-05-08T20:56:43.273114+0000","last_clean":"2024-05-08T20:56:43.273114+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T20:56:43.273114+0000","last_undegraded":"2024-05-08T20:56:43.273114+0000","last_fullsized":"2024-05-08T20:56:43.273114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786739+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:56:42.786739+0000","last_peered":"2024-05-08T20:56:42.786739+0000","last_clean":"2024-05-08T20:56:42.786739+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:56:42.786739+0000","last_undegraded":"2024-05-08T20:56:42.786739+0000","last_fullsized":"2024-05-08T20:56:42.786739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273150+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T20:56:43.273150+0000","last_peered":"2024-05-08T20:56:43.273150+0000","last_clean":"2024-05-08T20:56:43.273150+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T20:56:43.273150+0000","last_undegraded":"2024-05-08T20:56:43.273150+0000","last_fullsized":"2024-05-08T20:56:43.273150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042994+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:56:43.042994+0000","last_peered":"2024-05-08T20:56:43.042994+0000","last_clean":"2024-05-08T20:56:43.042994+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:56:43.042994+0000","last_undegraded":"2024-05-08T20:56:43.042994+0000","last_fullsized":"2024-05-08T20:56:43.042994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042960+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T20:56:43.042960+0000","last_peered":"2024-05-08T20:56:43.042960+0000","last_clean":"2024-05-08T20:56:43.042960+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T20:56:43.042960+0000","last_undegraded":"2024-05-08T20:56:43.042960+0000","last_fullsized":"2024-05-08T20:56:43.042960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793237+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:56:42.793237+0000","last_peered":"2024-05-08T20:56:42.793237+0000","last_clean":"2024-05-08T20:56:42.793237+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:56:42.793237+0000","last_undegraded":"2024-05-08T20:56:42.793237+0000","last_fullsized":"2024-05-08T20:56:42.793237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787710+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:56:42.787710+0000","last_peered":"2024-05-08T20:56:42.787710+0000","last_clean":"2024-05-08T20:56:42.787710+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:56:42.787710+0000","last_undegraded":"2024-05-08T20:56:42.787710+0000","last_fullsized":"2024-05-08T20:56:42.787710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273687+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T20:56:43.273687+0000","last_peered":"2024-05-08T20:56:43.273687+0000","last_clean":"2024-05-08T20:56:43.273687+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T20:56:43.273687+0000","last_undegraded":"2024-05-08T20:56:43.273687+0000","last_fullsized":"2024-05-08T20:56:43.273687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793472+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:56:42.793472+0000","last_peered":"2024-05-08T20:56:42.793472+0000","last_clean":"2024-05-08T20:56:42.793472+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:56:42.793472+0000","last_undegraded":"2024-05-08T20:56:42.793472+0000","last_fullsized":"2024-05-08T20:56:42.793472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273910+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T20:56:43.273910+0000","last_peered":"2024-05-08T20:56:43.273910+0000","last_clean":"2024-05-08T20:56:43.273910+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T20:56:43.273910+0000","last_undegraded":"2024-05-08T20:56:43.273910+0000","last_fullsized":"2024-05-08T20:56:43.273910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786606+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:56:42.786606+0000","last_peered":"2024-05-08T20:56:42.786606+0000","last_clean":"2024-05-08T20:56:42.786606+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:56:42.786606+0000","last_undegraded":"2024-05-08T20:56:42.786606+0000","last_fullsized":"2024-05-08T20:56:42.786606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786994+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T20:56:42.786994+0000","last_peered":"2024-05-08T20:56:42.786994+0000","last_clean":"2024-05-08T20:56:42.786994+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T20:56:42.786994+0000","last_undegraded":"2024-05-08T20:56:42.786994+0000","last_fullsized":"2024-05-08T20:56:42.786994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793733+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:56:42.793733+0000","last_peered":"2024-05-08T20:56:42.793733+0000","last_clean":"2024-05-08T20:56:42.793733+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:56:42.793733+0000","last_undegraded":"2024-05-08T20:56:42.793733+0000","last_fullsized":"2024-05-08T20:56:42.793733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273347+0000","last_change":"2024-05-08T20:56:41.806254+0000","last_active":"2024-05-08T20:56:43.273347+0000","last_peered":"2024-05-08T20:56:43.273347+0000","last_clean":"2024-05-08T20:56:43.273347+0000","last_became_active":"2024-05-08T20:56:41.806015+0000","last_became_peered":"2024-05-08T20:56:41.806015+0000","last_unstale":"2024-05-08T20:56:43.273347+0000","last_undegraded":"2024-05-08T20:56:43.273347+0000","last_fullsized":"2024-05-08T20:56:43.273347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T20:56:41.789181+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:56:41.789181+0000","last_peered":"2024-05-08T20:56:41.789181+0000","last_clean":"2024-05-08T20:56:41.789181+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:56:41.789181+0000","last_undegraded":"2024-05-08T20:56:41.789181+0000","last_fullsized":"2024-05-08T20:56:41.789181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786683+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:56:42.786683+0000","last_peered":"2024-05-08T20:56:42.786683+0000","last_clean":"2024-05-08T20:56:42.786683+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:56:42.786683+0000","last_undegraded":"2024-05-08T20:56:42.786683+0000","last_fullsized":"2024-05-08T20:56:42.786683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273520+0000","last_change":"2024-05-08T20:56:41.810087+0000","last_active":"2024-05-08T20:56:43.273520+0000","last_peered":"2024-05-08T20:56:43.273520+0000","last_clean":"2024-05-08T20:56:43.273520+0000","last_became_active":"2024-05-08T20:56:41.809880+0000","last_became_peered":"2024-05-08T20:56:41.809880+0000","last_unstale":"2024-05-08T20:56:43.273520+0000","last_undegraded":"2024-05-08T20:56:43.273520+0000","last_fullsized":"2024-05-08T20:56:43.273520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272644+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:56:43.272644+0000","last_peered":"2024-05-08T20:56:43.272644+0000","last_clean":"2024-05-08T20:56:43.272644+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:56:43.272644+0000","last_undegraded":"2024-05-08T20:56:43.272644+0000","last_fullsized":"2024-05-08T20:56:43.272644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272560+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T20:56:43.272560+0000","last_peered":"2024-05-08T20:56:43.272560+0000","last_clean":"2024-05-08T20:56:43.272560+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T20:56:43.272560+0000","last_undegraded":"2024-05-08T20:56:43.272560+0000","last_fullsized":"2024-05-08T20:56:43.272560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793515+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T20:56:42.793515+0000","last_peered":"2024-05-08T20:56:42.793515+0000","last_clean":"2024-05-08T20:56:42.793515+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T20:56:42.793515+0000","last_undegraded":"2024-05-08T20:56:42.793515+0000","last_fullsized":"2024-05-08T20:56:42.793515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785850+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T20:56:42.785850+0000","last_peered":"2024-05-08T20:56:42.785850+0000","last_clean":"2024-05-08T20:56:42.785850+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T20:56:42.785850+0000","last_undegraded":"2024-05-08T20:56:42.785850+0000","last_fullsized":"2024-05-08T20:56:42.785850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786822+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:56:42.786822+0000","last_peered":"2024-05-08T20:56:42.786822+0000","last_clean":"2024-05-08T20:56:42.786822+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:56:42.786822+0000","last_undegraded":"2024-05-08T20:56:42.786822+0000","last_fullsized":"2024-05-08T20:56:42.786822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787954+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T20:56:42.787954+0000","last_peered":"2024-05-08T20:56:42.787954+0000","last_clean":"2024-05-08T20:56:42.787954+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T20:56:42.787954+0000","last_undegraded":"2024-05-08T20:56:42.787954+0000","last_fullsized":"2024-05-08T20:56:42.787954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786292+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:56:42.786292+0000","last_peered":"2024-05-08T20:56:42.786292+0000","last_clean":"2024-05-08T20:56:42.786292+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:56:42.786292+0000","last_undegraded":"2024-05-08T20:56:42.786292+0000","last_fullsized":"2024-05-08T20:56:42.786292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787425+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T20:56:42.787425+0000","last_peered":"2024-05-08T20:56:42.787425+0000","last_clean":"2024-05-08T20:56:42.787425+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T20:56:42.787425+0000","last_undegraded":"2024-05-08T20:56:42.787425+0000","last_fullsized":"2024-05-08T20:56:42.787425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273904+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:56:43.273904+0000","last_peered":"2024-05-08T20:56:43.273904+0000","last_clean":"2024-05-08T20:56:43.273904+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:56:43.273904+0000","last_undegraded":"2024-05-08T20:56:43.273904+0000","last_fullsized":"2024-05-08T20:56:43.273904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786509+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T20:56:42.786509+0000","last_peered":"2024-05-08T20:56:42.786509+0000","last_clean":"2024-05-08T20:56:42.786509+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T20:56:42.786509+0000","last_undegraded":"2024-05-08T20:56:42.786509+0000","last_fullsized":"2024-05-08T20:56:42.786509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.718144+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T20:56:43.718144+0000","last_peered":"2024-05-08T20:56:43.718144+0000","last_clean":"2024-05-08T20:56:43.718144+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T20:56:43.718144+0000","last_undegraded":"2024-05-08T20:56:43.718144+0000","last_fullsized":"2024-05-08T20:56:43.718144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274410+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T20:56:43.274410+0000","last_peered":"2024-05-08T20:56:43.274410+0000","last_clean":"2024-05-08T20:56:43.274410+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T20:56:43.274410+0000","last_undegraded":"2024-05-08T20:56:43.274410+0000","last_fullsized":"2024-05-08T20:56:43.274410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043769+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T20:56:43.043769+0000","last_peered":"2024-05-08T20:56:43.043769+0000","last_clean":"2024-05-08T20:56:43.043769+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T20:56:43.043769+0000","last_undegraded":"2024-05-08T20:56:43.043769+0000","last_fullsized":"2024-05-08T20:56:43.043769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.275110+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T20:56:43.275110+0000","last_peered":"2024-05-08T20:56:43.275110+0000","last_clean":"2024-05-08T20:56:43.275110+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T20:56:43.275110+0000","last_undegraded":"2024-05-08T20:56:43.275110+0000","last_fullsized":"2024-05-08T20:56:43.275110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272611+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:56:43.272611+0000","last_peered":"2024-05-08T20:56:43.272611+0000","last_clean":"2024-05-08T20:56:43.272611+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:56:43.272611+0000","last_undegraded":"2024-05-08T20:56:43.272611+0000","last_fullsized":"2024-05-08T20:56:43.272611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787774+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T20:56:42.787774+0000","last_peered":"2024-05-08T20:56:42.787774+0000","last_clean":"2024-05-08T20:56:42.787774+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T20:56:42.787774+0000","last_undegraded":"2024-05-08T20:56:42.787774+0000","last_fullsized":"2024-05-08T20:56:42.787774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785954+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:56:42.785954+0000","last_peered":"2024-05-08T20:56:42.785954+0000","last_clean":"2024-05-08T20:56:42.785954+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:56:42.785954+0000","last_undegraded":"2024-05-08T20:56:42.785954+0000","last_fullsized":"2024-05-08T20:56:42.785954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273075+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T20:56:43.273075+0000","last_peered":"2024-05-08T20:56:43.273075+0000","last_clean":"2024-05-08T20:56:43.273075+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T20:56:43.273075+0000","last_undegraded":"2024-05-08T20:56:43.273075+0000","last_fullsized":"2024-05-08T20:56:43.273075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786223+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:56:42.786223+0000","last_peered":"2024-05-08T20:56:42.786223+0000","last_clean":"2024-05-08T20:56:42.786223+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:56:42.786223+0000","last_undegraded":"2024-05-08T20:56:42.786223+0000","last_fullsized":"2024-05-08T20:56:42.786223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274284+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T20:56:43.274284+0000","last_peered":"2024-05-08T20:56:43.274284+0000","last_clean":"2024-05-08T20:56:43.274284+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T20:56:43.274284+0000","last_undegraded":"2024-05-08T20:56:43.274284+0000","last_fullsized":"2024-05-08T20:56:43.274284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273439+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:56:43.273439+0000","last_peered":"2024-05-08T20:56:43.273439+0000","last_clean":"2024-05-08T20:56:43.273439+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:56:43.273439+0000","last_undegraded":"2024-05-08T20:56:43.273439+0000","last_fullsized":"2024-05-08T20:56:43.273439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043061+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T20:56:43.043061+0000","last_peered":"2024-05-08T20:56:43.043061+0000","last_clean":"2024-05-08T20:56:43.043061+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T20:56:43.043061+0000","last_undegraded":"2024-05-08T20:56:43.043061+0000","last_fullsized":"2024-05-08T20:56:43.043061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787405+0000","last_change":"2024-05-08T20:56:41.808438+0000","last_active":"2024-05-08T20:56:42.787405+0000","last_peered":"2024-05-08T20:56:42.787405+0000","last_clean":"2024-05-08T20:56:42.787405+0000","last_became_active":"2024-05-08T20:56:41.808198+0000","last_became_peered":"2024-05-08T20:56:41.808198+0000","last_unstale":"2024-05-08T20:56:42.787405+0000","last_undegraded":"2024-05-08T20:56:42.787405+0000","last_fullsized":"2024-05-08T20:56:42.787405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273235+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:56:43.273235+0000","last_peered":"2024-05-08T20:56:43.273235+0000","last_clean":"2024-05-08T20:56:43.273235+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:56:43.273235+0000","last_undegraded":"2024-05-08T20:56:43.273235+0000","last_fullsized":"2024-05-08T20:56:43.273235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787094+0000","last_change":"2024-05-08T20:56:41.809061+0000","last_active":"2024-05-08T20:56:42.787094+0000","last_peered":"2024-05-08T20:56:42.787094+0000","last_clean":"2024-05-08T20:56:42.787094+0000","last_became_active":"2024-05-08T20:56:41.808633+0000","last_became_peered":"2024-05-08T20:56:41.808633+0000","last_unstale":"2024-05-08T20:56:42.787094+0000","last_undegraded":"2024-05-08T20:56:42.787094+0000","last_fullsized":"2024-05-08T20:56:42.787094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273650+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T20:56:43.273650+0000","last_peered":"2024-05-08T20:56:43.273650+0000","last_clean":"2024-05-08T20:56:43.273650+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T20:56:43.273650+0000","last_undegraded":"2024-05-08T20:56:43.273650+0000","last_fullsized":"2024-05-08T20:56:43.273650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273560+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T20:56:43.273560+0000","last_peered":"2024-05-08T20:56:43.273560+0000","last_clean":"2024-05-08T20:56:43.273560+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T20:56:43.273560+0000","last_undegraded":"2024-05-08T20:56:43.273560+0000","last_fullsized":"2024-05-08T20:56:43.273560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274424+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:56:43.274424+0000","last_peered":"2024-05-08T20:56:43.274424+0000","last_clean":"2024-05-08T20:56:43.274424+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:56:43.274424+0000","last_undegraded":"2024-05-08T20:56:43.274424+0000","last_fullsized":"2024-05-08T20:56:43.274424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T20:56:43.273978+0000","last_peered":"2024-05-08T20:56:43.273978+0000","last_clean":"2024-05-08T20:56:43.273978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T20:56:43.273978+0000","last_undegraded":"2024-05-08T20:56:43.273978+0000","last_fullsized":"2024-05-08T20:56:43.273978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:56:49.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:56:50.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 Processor -- start 2024-05-08T20:56:50.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- start start 2024-05-08T20:56:50.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a40b3c20 0x7fe1a41624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1a4070110 0x7fe1a40705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4158960 con 0x7fe1a4071e70 2024-05-08T20:56:50.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a40b1f60 con 0x7fe1a4070110 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40ae990 con 0x7fe1a40b3c20 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1a4070110 0x7fe1a40705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1a4070110 0x7fe1a40705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50836/0 (socket says 172.21.15.107:50836) 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 -- 172.21.15.107:0/4146718072 learned_addr learned my addr 172.21.15.107:0/4146718072 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a8df8700 1 --2- 172.21.15.107:0/4146718072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a40b3c20 0x7fe1a41624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 -- 172.21.15.107:0/4146718072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a40b3c20 msgr2=0x7fe1a41624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 --2- 172.21.15.107:0/4146718072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a40b3c20 0x7fe1a41624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 -- 172.21.15.107:0/4146718072 >> v1:172.21.15.195:6789/0 conn(0x7fe1a4071e70 legacy=0x7fe1a40b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 -- 172.21.15.107:0/4146718072 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40b2170 con 0x7fe1a4070110 2024-05-08T20:56:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a95f9700 1 --2- 172.21.15.107:0/4146718072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a4070110 0x7fe1a40705a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009910 tx=0x7fe19c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc4c23d204921a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a37fe700 1 -- 172.21.15.107:0/4146718072 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c011830 con 0x7fe1a4070110 2024-05-08T20:56:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a37fe700 1 -- 172.21.15.107:0/4146718072 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c011990 con 0x7fe1a4070110 2024-05-08T20:56:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a37fe700 1 -- 172.21.15.107:0/4146718072 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c011d40 con 0x7fe1a4070110 2024-05-08T20:56:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/4146718072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a4070110 msgr2=0x7fe1a40705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/4146718072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a4070110 0x7fe1a40705a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009910 tx=0x7fe19c009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/4146718072 shutdown_connections 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/4146718072 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a4070110 0x7fe1a40705a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/4146718072 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a40b3c20 0x7fe1a41624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/4146718072 >> 172.21.15.107:0/4146718072 conn(0x7fe1a406c330 msgr2=0x7fe1a406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/4146718072 shutdown_connections 2024-05-08T20:56:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.032+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/4146718072 wait complete. 2024-05-08T20:56:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 Processor -- start 2024-05-08T20:56:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 -- start start 2024-05-08T20:56:50.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1a4070110 0x7fe1a41513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a4071e70 0x7fe1a415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a40b3c20 0x7fe1a414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a415b500 con 0x7fe1a40b3c20 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a414e870 con 0x7fe1a4070110 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a9dfa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4159f20 con 0x7fe1a4071e70 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a95f9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a40b3c20 0x7fe1a414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a95f9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a40b3c20 0x7fe1a414e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50850/0 (socket says 172.21.15.107:50850) 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a95f9700 1 -- 172.21.15.107:0/1098324415 learned_addr learned my addr 172.21.15.107:0/1098324415 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1a4070110 0x7fe1a41513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a3fff700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a4071e70 0x7fe1a415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 -- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a4071e70 msgr2=0x7fe1a415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a4071e70 0x7fe1a415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 -- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a40b3c20 msgr2=0x7fe1a414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a40b3c20 0x7fe1a414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 -- 172.21.15.107:0/1098324415 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c009570 con 0x7fe1a4070110 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a8df8700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1a4070110 0x7fe1a41513a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe194009db0 tx=0x7fe19400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.036+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194009c20 con 0x7fe1a4070110 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19400f040 con 0x7fe1a4070110 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a415a200 con 0x7fe1a4070110 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194014480 con 0x7fe1a4070110 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a415a7c0 con 0x7fe1a4070110 2024-05-08T20:56:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40684b0 con 0x7fe1a4070110 2024-05-08T20:56:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1940145e0 con 0x7fe1a4070110 2024-05-08T20:56:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a17fa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe190066730 0x7fe190068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe194084cd0 con 0x7fe1a4070110 2024-05-08T20:56:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a3fff700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe190066730 0x7fe190068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.040+0000 7fe1a3fff700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe190066730 0x7fe190068bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4151160 tx=0x7fe198009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.052+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe194051fc0 con 0x7fe1a4070110 2024-05-08T20:56:50.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.204+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1a40b2a10 con 0x7fe190066730 2024-05-08T20:56:50.227 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.220+0000 7fe1a17fa700 1 -- 172.21.15.107:0/1098324415 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264462 (secure 0 0 0) 0x7fe198001540 con 0x7fe190066730 2024-05-08T20:56:50.233 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:50.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe190066730 msgr2=0x7fe190068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe190066730 0x7fe190068bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4151160 tx=0x7fe198009040 comp rx=0 tx=0).stop 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1a4070110 msgr2=0x7fe1a41513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1a4070110 0x7fe1a41513a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe194009db0 tx=0x7fe19400c3a0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 shutdown_connections 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1a40b3c20 0x7fe1a414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe190066730 0x7fe190068bf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe1a4071e70 0x7fe1a415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 --2- 172.21.15.107:0/1098324415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1a4070110 0x7fe1a41513a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 >> 172.21.15.107:0/1098324415 conn(0x7fe1a406c330 msgr2=0x7fe1a40ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 shutdown_connections 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.224+0000 7fe1a9dfa700 1 -- 172.21.15.107:0/1098324415 wait complete. 2024-05-08T20:56:50.237 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T20:56:50.248 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-08T20:56:48.698742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235408,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739312,"statfs":{"total":773094113280,"available":772853055488,"internally_reserved":0,"allocated":2887680,"data_stored":1751625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":238014010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.307886"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273716+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T20:56:43.273716+0000","last_peered":"2024-05-08T20:56:43.273716+0000","last_clean":"2024-05-08T20:56:43.273716+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T20:56:43.273716+0000","last_undegraded":"2024-05-08T20:56:43.273716+0000","last_fullsized":"2024-05-08T20:56:43.273716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786417+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T20:56:42.786417+0000","last_peered":"2024-05-08T20:56:42.786417+0000","last_clean":"2024-05-08T20:56:42.786417+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T20:56:42.786417+0000","last_undegraded":"2024-05-08T20:56:42.786417+0000","last_fullsized":"2024-05-08T20:56:42.786417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273684+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T20:56:43.273684+0000","last_peered":"2024-05-08T20:56:43.273684+0000","last_clean":"2024-05-08T20:56:43.273684+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T20:56:43.273684+0000","last_undegraded":"2024-05-08T20:56:43.273684+0000","last_fullsized":"2024-05-08T20:56:43.273684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786779+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T20:56:42.786779+0000","last_peered":"2024-05-08T20:56:42.786779+0000","last_clean":"2024-05-08T20:56:42.786779+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T20:56:42.786779+0000","last_undegraded":"2024-05-08T20:56:42.786779+0000","last_fullsized":"2024-05-08T20:56:42.786779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273146+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T20:56:43.273146+0000","last_peered":"2024-05-08T20:56:43.273146+0000","last_clean":"2024-05-08T20:56:43.273146+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T20:56:43.273146+0000","last_undegraded":"2024-05-08T20:56:43.273146+0000","last_fullsized":"2024-05-08T20:56:43.273146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786495+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T20:56:42.786495+0000","last_peered":"2024-05-08T20:56:42.786495+0000","last_clean":"2024-05-08T20:56:42.786495+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T20:56:42.786495+0000","last_undegraded":"2024-05-08T20:56:42.786495+0000","last_fullsized":"2024-05-08T20:56:42.786495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272601+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T20:56:43.272601+0000","last_peered":"2024-05-08T20:56:43.272601+0000","last_clean":"2024-05-08T20:56:43.272601+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T20:56:43.272601+0000","last_undegraded":"2024-05-08T20:56:43.272601+0000","last_fullsized":"2024-05-08T20:56:43.272601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273717+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T20:56:43.273717+0000","last_peered":"2024-05-08T20:56:43.273717+0000","last_clean":"2024-05-08T20:56:43.273717+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T20:56:43.273717+0000","last_undegraded":"2024-05-08T20:56:43.273717+0000","last_fullsized":"2024-05-08T20:56:43.273717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043718+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T20:56:43.043718+0000","last_peered":"2024-05-08T20:56:43.043718+0000","last_clean":"2024-05-08T20:56:43.043718+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T20:56:43.043718+0000","last_undegraded":"2024-05-08T20:56:43.043718+0000","last_fullsized":"2024-05-08T20:56:43.043718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043303+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T20:56:43.043303+0000","last_peered":"2024-05-08T20:56:43.043303+0000","last_clean":"2024-05-08T20:56:43.043303+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T20:56:43.043303+0000","last_undegraded":"2024-05-08T20:56:43.043303+0000","last_fullsized":"2024-05-08T20:56:43.043303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788169+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T20:56:42.788169+0000","last_peered":"2024-05-08T20:56:42.788169+0000","last_clean":"2024-05-08T20:56:42.788169+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T20:56:42.788169+0000","last_undegraded":"2024-05-08T20:56:42.788169+0000","last_fullsized":"2024-05-08T20:56:42.788169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274034+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T20:56:43.274034+0000","last_peered":"2024-05-08T20:56:43.274034+0000","last_clean":"2024-05-08T20:56:43.274034+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T20:56:43.274034+0000","last_undegraded":"2024-05-08T20:56:43.274034+0000","last_fullsized":"2024-05-08T20:56:43.274034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273554+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T20:56:43.273554+0000","last_peered":"2024-05-08T20:56:43.273554+0000","last_clean":"2024-05-08T20:56:43.273554+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T20:56:43.273554+0000","last_undegraded":"2024-05-08T20:56:43.273554+0000","last_fullsized":"2024-05-08T20:56:43.273554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785960+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T20:56:42.785960+0000","last_peered":"2024-05-08T20:56:42.785960+0000","last_clean":"2024-05-08T20:56:42.785960+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T20:56:42.785960+0000","last_undegraded":"2024-05-08T20:56:42.785960+0000","last_fullsized":"2024-05-08T20:56:42.785960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786454+0000","last_change":"2024-05-08T20:56:41.791132+0000","last_active":"2024-05-08T20:56:42.786454+0000","last_peered":"2024-05-08T20:56:42.786454+0000","last_clean":"2024-05-08T20:56:42.786454+0000","last_became_active":"2024-05-08T20:56:41.790838+0000","last_became_peered":"2024-05-08T20:56:41.790838+0000","last_unstale":"2024-05-08T20:56:42.786454+0000","last_undegraded":"2024-05-08T20:56:42.786454+0000","last_fullsized":"2024-05-08T20:56:42.786454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787321+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T20:56:42.787321+0000","last_peered":"2024-05-08T20:56:42.787321+0000","last_clean":"2024-05-08T20:56:42.787321+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T20:56:42.787321+0000","last_undegraded":"2024-05-08T20:56:42.787321+0000","last_fullsized":"2024-05-08T20:56:42.787321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793458+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T20:56:42.793458+0000","last_peered":"2024-05-08T20:56:42.793458+0000","last_clean":"2024-05-08T20:56:42.793458+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T20:56:42.793458+0000","last_undegraded":"2024-05-08T20:56:42.793458+0000","last_fullsized":"2024-05-08T20:56:42.793458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273673+0000","last_change":"2024-05-08T20:56:41.802323+0000","last_active":"2024-05-08T20:56:43.273673+0000","last_peered":"2024-05-08T20:56:43.273673+0000","last_clean":"2024-05-08T20:56:43.273673+0000","last_became_active":"2024-05-08T20:56:41.798890+0000","last_became_peered":"2024-05-08T20:56:41.798890+0000","last_unstale":"2024-05-08T20:56:43.273673+0000","last_undegraded":"2024-05-08T20:56:43.273673+0000","last_fullsized":"2024-05-08T20:56:43.273673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043301+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.043301+0000","last_peered":"2024-05-08T20:56:43.043301+0000","last_clean":"2024-05-08T20:56:43.043301+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.043301+0000","last_undegraded":"2024-05-08T20:56:43.043301+0000","last_fullsized":"2024-05-08T20:56:43.043301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273478+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T20:56:43.273478+0000","last_peered":"2024-05-08T20:56:43.273478+0000","last_clean":"2024-05-08T20:56:43.273478+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T20:56:43.273478+0000","last_undegraded":"2024-05-08T20:56:43.273478+0000","last_fullsized":"2024-05-08T20:56:43.273478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786653+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T20:56:42.786653+0000","last_peered":"2024-05-08T20:56:42.786653+0000","last_clean":"2024-05-08T20:56:42.786653+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T20:56:42.786653+0000","last_undegraded":"2024-05-08T20:56:42.786653+0000","last_fullsized":"2024-05-08T20:56:42.786653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272750+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T20:56:43.272750+0000","last_peered":"2024-05-08T20:56:43.272750+0000","last_clean":"2024-05-08T20:56:43.272750+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T20:56:43.272750+0000","last_undegraded":"2024-05-08T20:56:43.272750+0000","last_fullsized":"2024-05-08T20:56:43.272750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786490+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T20:56:42.786490+0000","last_peered":"2024-05-08T20:56:42.786490+0000","last_clean":"2024-05-08T20:56:42.786490+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T20:56:42.786490+0000","last_undegraded":"2024-05-08T20:56:42.786490+0000","last_fullsized":"2024-05-08T20:56:42.786490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274272+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T20:56:43.274272+0000","last_peered":"2024-05-08T20:56:43.274272+0000","last_clean":"2024-05-08T20:56:43.274272+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T20:56:43.274272+0000","last_undegraded":"2024-05-08T20:56:43.274272+0000","last_fullsized":"2024-05-08T20:56:43.274272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043789+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T20:56:43.043789+0000","last_peered":"2024-05-08T20:56:43.043789+0000","last_clean":"2024-05-08T20:56:43.043789+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T20:56:43.043789+0000","last_undegraded":"2024-05-08T20:56:43.043789+0000","last_fullsized":"2024-05-08T20:56:43.043789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786283+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T20:56:42.786283+0000","last_peered":"2024-05-08T20:56:42.786283+0000","last_clean":"2024-05-08T20:56:42.786283+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T20:56:42.786283+0000","last_undegraded":"2024-05-08T20:56:42.786283+0000","last_fullsized":"2024-05-08T20:56:42.786283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274673+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T20:56:43.274673+0000","last_peered":"2024-05-08T20:56:43.274673+0000","last_clean":"2024-05-08T20:56:43.274673+0000","last_became_active":"2024-05-08T20:56:41.810632+0000","last_became_peered":"2024-05-08T20:56:41.810632+0000","last_unstale":"2024-05-08T20:56:43.274673+0000","last_undegraded":"2024-05-08T20:56:43.274673+0000","last_fullsized":"2024-05-08T20:56:43.274673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273719+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T20:56:43.273719+0000","last_peered":"2024-05-08T20:56:43.273719+0000","last_clean":"2024-05-08T20:56:43.273719+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T20:56:43.273719+0000","last_undegraded":"2024-05-08T20:56:43.273719+0000","last_fullsized":"2024-05-08T20:56:43.273719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787815+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T20:56:42.787815+0000","last_peered":"2024-05-08T20:56:42.787815+0000","last_clean":"2024-05-08T20:56:42.787815+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T20:56:42.787815+0000","last_undegraded":"2024-05-08T20:56:42.787815+0000","last_fullsized":"2024-05-08T20:56:42.787815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793490+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T20:56:42.793490+0000","last_peered":"2024-05-08T20:56:42.793490+0000","last_clean":"2024-05-08T20:56:42.793490+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T20:56:42.793490+0000","last_undegraded":"2024-05-08T20:56:42.793490+0000","last_fullsized":"2024-05-08T20:56:42.793490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042896+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T20:56:43.042896+0000","last_peered":"2024-05-08T20:56:43.042896+0000","last_clean":"2024-05-08T20:56:43.042896+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T20:56:43.042896+0000","last_undegraded":"2024-05-08T20:56:43.042896+0000","last_fullsized":"2024-05-08T20:56:43.042896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787032+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T20:56:42.787032+0000","last_peered":"2024-05-08T20:56:42.787032+0000","last_clean":"2024-05-08T20:56:42.787032+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T20:56:42.787032+0000","last_undegraded":"2024-05-08T20:56:42.787032+0000","last_fullsized":"2024-05-08T20:56:42.787032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274508+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:56:43.274508+0000","last_peered":"2024-05-08T20:56:43.274508+0000","last_clean":"2024-05-08T20:56:43.274508+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:56:43.274508+0000","last_undegraded":"2024-05-08T20:56:43.274508+0000","last_fullsized":"2024-05-08T20:56:43.274508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043109+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:56:43.043109+0000","last_peered":"2024-05-08T20:56:43.043109+0000","last_clean":"2024-05-08T20:56:43.043109+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:56:43.043109+0000","last_undegraded":"2024-05-08T20:56:43.043109+0000","last_fullsized":"2024-05-08T20:56:43.043109+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273264+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:56:43.273264+0000","last_peered":"2024-05-08T20:56:43.273264+0000","last_clean":"2024-05-08T20:56:43.273264+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:56:43.273264+0000","last_undegraded":"2024-05-08T20:56:43.273264+0000","last_fullsized":"2024-05-08T20:56:43.273264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272849+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T20:56:43.272849+0000","last_peered":"2024-05-08T20:56:43.272849+0000","last_clean":"2024-05-08T20:56:43.272849+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T20:56:43.272849+0000","last_undegraded":"2024-05-08T20:56:43.272849+0000","last_fullsized":"2024-05-08T20:56:43.272849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:56:42.786560+0000","last_peered":"2024-05-08T20:56:42.786560+0000","last_clean":"2024-05-08T20:56:42.786560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:56:42.786560+0000","last_undegraded":"2024-05-08T20:56:42.786560+0000","last_fullsized":"2024-05-08T20:56:42.786560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785898+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T20:56:42.785898+0000","last_peered":"2024-05-08T20:56:42.785898+0000","last_clean":"2024-05-08T20:56:42.785898+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T20:56:42.785898+0000","last_undegraded":"2024-05-08T20:56:42.785898+0000","last_fullsized":"2024-05-08T20:56:42.785898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043678+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:56:43.043678+0000","last_peered":"2024-05-08T20:56:43.043678+0000","last_clean":"2024-05-08T20:56:43.043678+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:56:43.043678+0000","last_undegraded":"2024-05-08T20:56:43.043678+0000","last_fullsized":"2024-05-08T20:56:43.043678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787265+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T20:56:42.787265+0000","last_peered":"2024-05-08T20:56:42.787265+0000","last_clean":"2024-05-08T20:56:42.787265+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T20:56:42.787265+0000","last_undegraded":"2024-05-08T20:56:42.787265+0000","last_fullsized":"2024-05-08T20:56:42.787265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787227+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:56:42.787227+0000","last_peered":"2024-05-08T20:56:42.787227+0000","last_clean":"2024-05-08T20:56:42.787227+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:56:42.787227+0000","last_undegraded":"2024-05-08T20:56:42.787227+0000","last_fullsized":"2024-05-08T20:56:42.787227+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273777+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T20:56:43.273777+0000","last_peered":"2024-05-08T20:56:43.273777+0000","last_clean":"2024-05-08T20:56:43.273777+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T20:56:43.273777+0000","last_undegraded":"2024-05-08T20:56:43.273777+0000","last_fullsized":"2024-05-08T20:56:43.273777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786449+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T20:56:42.786449+0000","last_peered":"2024-05-08T20:56:42.786449+0000","last_clean":"2024-05-08T20:56:42.786449+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T20:56:42.786449+0000","last_undegraded":"2024-05-08T20:56:42.786449+0000","last_fullsized":"2024-05-08T20:56:42.786449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.788239+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T20:56:42.788239+0000","last_peered":"2024-05-08T20:56:42.788239+0000","last_clean":"2024-05-08T20:56:42.788239+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T20:56:42.788239+0000","last_undegraded":"2024-05-08T20:56:42.788239+0000","last_fullsized":"2024-05-08T20:56:42.788239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043359+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:56:43.043359+0000","last_peered":"2024-05-08T20:56:43.043359+0000","last_clean":"2024-05-08T20:56:43.043359+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:56:43.043359+0000","last_undegraded":"2024-05-08T20:56:43.043359+0000","last_fullsized":"2024-05-08T20:56:43.043359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273305+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T20:56:43.273305+0000","last_peered":"2024-05-08T20:56:43.273305+0000","last_clean":"2024-05-08T20:56:43.273305+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T20:56:43.273305+0000","last_undegraded":"2024-05-08T20:56:43.273305+0000","last_fullsized":"2024-05-08T20:56:43.273305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273945+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:56:43.273945+0000","last_peered":"2024-05-08T20:56:43.273945+0000","last_clean":"2024-05-08T20:56:43.273945+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:56:43.273945+0000","last_undegraded":"2024-05-08T20:56:43.273945+0000","last_fullsized":"2024-05-08T20:56:43.273945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273114+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T20:56:43.273114+0000","last_peered":"2024-05-08T20:56:43.273114+0000","last_clean":"2024-05-08T20:56:43.273114+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T20:56:43.273114+0000","last_undegraded":"2024-05-08T20:56:43.273114+0000","last_fullsized":"2024-05-08T20:56:43.273114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786739+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:56:42.786739+0000","last_peered":"2024-05-08T20:56:42.786739+0000","last_clean":"2024-05-08T20:56:42.786739+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:56:42.786739+0000","last_undegraded":"2024-05-08T20:56:42.786739+0000","last_fullsized":"2024-05-08T20:56:42.786739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273150+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T20:56:43.273150+0000","last_peered":"2024-05-08T20:56:43.273150+0000","last_clean":"2024-05-08T20:56:43.273150+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T20:56:43.273150+0000","last_undegraded":"2024-05-08T20:56:43.273150+0000","last_fullsized":"2024-05-08T20:56:43.273150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042994+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:56:43.042994+0000","last_peered":"2024-05-08T20:56:43.042994+0000","last_clean":"2024-05-08T20:56:43.042994+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:56:43.042994+0000","last_undegraded":"2024-05-08T20:56:43.042994+0000","last_fullsized":"2024-05-08T20:56:43.042994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.042960+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T20:56:43.042960+0000","last_peered":"2024-05-08T20:56:43.042960+0000","last_clean":"2024-05-08T20:56:43.042960+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T20:56:43.042960+0000","last_undegraded":"2024-05-08T20:56:43.042960+0000","last_fullsized":"2024-05-08T20:56:43.042960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793237+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:56:42.793237+0000","last_peered":"2024-05-08T20:56:42.793237+0000","last_clean":"2024-05-08T20:56:42.793237+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:56:42.793237+0000","last_undegraded":"2024-05-08T20:56:42.793237+0000","last_fullsized":"2024-05-08T20:56:42.793237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272806+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T20:56:43.272806+0000","last_peered":"2024-05-08T20:56:43.272806+0000","last_clean":"2024-05-08T20:56:43.272806+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T20:56:43.272806+0000","last_undegraded":"2024-05-08T20:56:43.272806+0000","last_fullsized":"2024-05-08T20:56:43.272806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787710+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:56:42.787710+0000","last_peered":"2024-05-08T20:56:42.787710+0000","last_clean":"2024-05-08T20:56:42.787710+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:56:42.787710+0000","last_undegraded":"2024-05-08T20:56:42.787710+0000","last_fullsized":"2024-05-08T20:56:42.787710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273687+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T20:56:43.273687+0000","last_peered":"2024-05-08T20:56:43.273687+0000","last_clean":"2024-05-08T20:56:43.273687+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T20:56:43.273687+0000","last_undegraded":"2024-05-08T20:56:43.273687+0000","last_fullsized":"2024-05-08T20:56:43.273687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793472+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:56:42.793472+0000","last_peered":"2024-05-08T20:56:42.793472+0000","last_clean":"2024-05-08T20:56:42.793472+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:56:42.793472+0000","last_undegraded":"2024-05-08T20:56:42.793472+0000","last_fullsized":"2024-05-08T20:56:42.793472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273910+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T20:56:43.273910+0000","last_peered":"2024-05-08T20:56:43.273910+0000","last_clean":"2024-05-08T20:56:43.273910+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T20:56:43.273910+0000","last_undegraded":"2024-05-08T20:56:43.273910+0000","last_fullsized":"2024-05-08T20:56:43.273910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786606+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:56:42.786606+0000","last_peered":"2024-05-08T20:56:42.786606+0000","last_clean":"2024-05-08T20:56:42.786606+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:56:42.786606+0000","last_undegraded":"2024-05-08T20:56:42.786606+0000","last_fullsized":"2024-05-08T20:56:42.786606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786994+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T20:56:42.786994+0000","last_peered":"2024-05-08T20:56:42.786994+0000","last_clean":"2024-05-08T20:56:42.786994+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T20:56:42.786994+0000","last_undegraded":"2024-05-08T20:56:42.786994+0000","last_fullsized":"2024-05-08T20:56:42.786994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793733+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:56:42.793733+0000","last_peered":"2024-05-08T20:56:42.793733+0000","last_clean":"2024-05-08T20:56:42.793733+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:56:42.793733+0000","last_undegraded":"2024-05-08T20:56:42.793733+0000","last_fullsized":"2024-05-08T20:56:42.793733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273347+0000","last_change":"2024-05-08T20:56:41.806254+0000","last_active":"2024-05-08T20:56:43.273347+0000","last_peered":"2024-05-08T20:56:43.273347+0000","last_clean":"2024-05-08T20:56:43.273347+0000","last_became_active":"2024-05-08T20:56:41.806015+0000","last_became_peered":"2024-05-08T20:56:41.806015+0000","last_unstale":"2024-05-08T20:56:43.273347+0000","last_undegraded":"2024-05-08T20:56:43.273347+0000","last_fullsized":"2024-05-08T20:56:43.273347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-08T20:56:41.789181+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:56:41.789181+0000","last_peered":"2024-05-08T20:56:41.789181+0000","last_clean":"2024-05-08T20:56:41.789181+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:56:41.789181+0000","last_undegraded":"2024-05-08T20:56:41.789181+0000","last_fullsized":"2024-05-08T20:56:41.789181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786683+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:56:42.786683+0000","last_peered":"2024-05-08T20:56:42.786683+0000","last_clean":"2024-05-08T20:56:42.786683+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:56:42.786683+0000","last_undegraded":"2024-05-08T20:56:42.786683+0000","last_fullsized":"2024-05-08T20:56:42.786683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273520+0000","last_change":"2024-05-08T20:56:41.810087+0000","last_active":"2024-05-08T20:56:43.273520+0000","last_peered":"2024-05-08T20:56:43.273520+0000","last_clean":"2024-05-08T20:56:43.273520+0000","last_became_active":"2024-05-08T20:56:41.809880+0000","last_became_peered":"2024-05-08T20:56:41.809880+0000","last_unstale":"2024-05-08T20:56:43.273520+0000","last_undegraded":"2024-05-08T20:56:43.273520+0000","last_fullsized":"2024-05-08T20:56:43.273520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272644+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:56:43.272644+0000","last_peered":"2024-05-08T20:56:43.272644+0000","last_clean":"2024-05-08T20:56:43.272644+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:56:43.272644+0000","last_undegraded":"2024-05-08T20:56:43.272644+0000","last_fullsized":"2024-05-08T20:56:43.272644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272560+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T20:56:43.272560+0000","last_peered":"2024-05-08T20:56:43.272560+0000","last_clean":"2024-05-08T20:56:43.272560+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T20:56:43.272560+0000","last_undegraded":"2024-05-08T20:56:43.272560+0000","last_fullsized":"2024-05-08T20:56:43.272560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.793515+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T20:56:42.793515+0000","last_peered":"2024-05-08T20:56:42.793515+0000","last_clean":"2024-05-08T20:56:42.793515+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T20:56:42.793515+0000","last_undegraded":"2024-05-08T20:56:42.793515+0000","last_fullsized":"2024-05-08T20:56:42.793515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785850+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T20:56:42.785850+0000","last_peered":"2024-05-08T20:56:42.785850+0000","last_clean":"2024-05-08T20:56:42.785850+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T20:56:42.785850+0000","last_undegraded":"2024-05-08T20:56:42.785850+0000","last_fullsized":"2024-05-08T20:56:42.785850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786822+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:56:42.786822+0000","last_peered":"2024-05-08T20:56:42.786822+0000","last_clean":"2024-05-08T20:56:42.786822+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:56:42.786822+0000","last_undegraded":"2024-05-08T20:56:42.786822+0000","last_fullsized":"2024-05-08T20:56:42.786822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787954+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T20:56:42.787954+0000","last_peered":"2024-05-08T20:56:42.787954+0000","last_clean":"2024-05-08T20:56:42.787954+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T20:56:42.787954+0000","last_undegraded":"2024-05-08T20:56:42.787954+0000","last_fullsized":"2024-05-08T20:56:42.787954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786292+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:56:42.786292+0000","last_peered":"2024-05-08T20:56:42.786292+0000","last_clean":"2024-05-08T20:56:42.786292+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:56:42.786292+0000","last_undegraded":"2024-05-08T20:56:42.786292+0000","last_fullsized":"2024-05-08T20:56:42.786292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787425+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T20:56:42.787425+0000","last_peered":"2024-05-08T20:56:42.787425+0000","last_clean":"2024-05-08T20:56:42.787425+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T20:56:42.787425+0000","last_undegraded":"2024-05-08T20:56:42.787425+0000","last_fullsized":"2024-05-08T20:56:42.787425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273904+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:56:43.273904+0000","last_peered":"2024-05-08T20:56:43.273904+0000","last_clean":"2024-05-08T20:56:43.273904+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:56:43.273904+0000","last_undegraded":"2024-05-08T20:56:43.273904+0000","last_fullsized":"2024-05-08T20:56:43.273904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786509+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T20:56:42.786509+0000","last_peered":"2024-05-08T20:56:42.786509+0000","last_clean":"2024-05-08T20:56:42.786509+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T20:56:42.786509+0000","last_undegraded":"2024-05-08T20:56:42.786509+0000","last_fullsized":"2024-05-08T20:56:42.786509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.718144+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T20:56:43.718144+0000","last_peered":"2024-05-08T20:56:43.718144+0000","last_clean":"2024-05-08T20:56:43.718144+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T20:56:43.718144+0000","last_undegraded":"2024-05-08T20:56:43.718144+0000","last_fullsized":"2024-05-08T20:56:43.718144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274410+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T20:56:43.274410+0000","last_peered":"2024-05-08T20:56:43.274410+0000","last_clean":"2024-05-08T20:56:43.274410+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T20:56:43.274410+0000","last_undegraded":"2024-05-08T20:56:43.274410+0000","last_fullsized":"2024-05-08T20:56:43.274410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043769+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T20:56:43.043769+0000","last_peered":"2024-05-08T20:56:43.043769+0000","last_clean":"2024-05-08T20:56:43.043769+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T20:56:43.043769+0000","last_undegraded":"2024-05-08T20:56:43.043769+0000","last_fullsized":"2024-05-08T20:56:43.043769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.275110+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T20:56:43.275110+0000","last_peered":"2024-05-08T20:56:43.275110+0000","last_clean":"2024-05-08T20:56:43.275110+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T20:56:43.275110+0000","last_undegraded":"2024-05-08T20:56:43.275110+0000","last_fullsized":"2024-05-08T20:56:43.275110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.272611+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:56:43.272611+0000","last_peered":"2024-05-08T20:56:43.272611+0000","last_clean":"2024-05-08T20:56:43.272611+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:56:43.272611+0000","last_undegraded":"2024-05-08T20:56:43.272611+0000","last_fullsized":"2024-05-08T20:56:43.272611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787774+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T20:56:42.787774+0000","last_peered":"2024-05-08T20:56:42.787774+0000","last_clean":"2024-05-08T20:56:42.787774+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T20:56:42.787774+0000","last_undegraded":"2024-05-08T20:56:42.787774+0000","last_fullsized":"2024-05-08T20:56:42.787774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.785954+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:56:42.785954+0000","last_peered":"2024-05-08T20:56:42.785954+0000","last_clean":"2024-05-08T20:56:42.785954+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:56:42.785954+0000","last_undegraded":"2024-05-08T20:56:42.785954+0000","last_fullsized":"2024-05-08T20:56:42.785954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273075+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T20:56:43.273075+0000","last_peered":"2024-05-08T20:56:43.273075+0000","last_clean":"2024-05-08T20:56:43.273075+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T20:56:43.273075+0000","last_undegraded":"2024-05-08T20:56:43.273075+0000","last_fullsized":"2024-05-08T20:56:43.273075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.786223+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:56:42.786223+0000","last_peered":"2024-05-08T20:56:42.786223+0000","last_clean":"2024-05-08T20:56:42.786223+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:56:42.786223+0000","last_undegraded":"2024-05-08T20:56:42.786223+0000","last_fullsized":"2024-05-08T20:56:42.786223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274284+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T20:56:43.274284+0000","last_peered":"2024-05-08T20:56:43.274284+0000","last_clean":"2024-05-08T20:56:43.274284+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T20:56:43.274284+0000","last_undegraded":"2024-05-08T20:56:43.274284+0000","last_fullsized":"2024-05-08T20:56:43.274284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273439+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:56:43.273439+0000","last_peered":"2024-05-08T20:56:43.273439+0000","last_clean":"2024-05-08T20:56:43.273439+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:56:43.273439+0000","last_undegraded":"2024-05-08T20:56:43.273439+0000","last_fullsized":"2024-05-08T20:56:43.273439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.043061+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T20:56:43.043061+0000","last_peered":"2024-05-08T20:56:43.043061+0000","last_clean":"2024-05-08T20:56:43.043061+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T20:56:43.043061+0000","last_undegraded":"2024-05-08T20:56:43.043061+0000","last_fullsized":"2024-05-08T20:56:43.043061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787405+0000","last_change":"2024-05-08T20:56:41.808438+0000","last_active":"2024-05-08T20:56:42.787405+0000","last_peered":"2024-05-08T20:56:42.787405+0000","last_clean":"2024-05-08T20:56:42.787405+0000","last_became_active":"2024-05-08T20:56:41.808198+0000","last_became_peered":"2024-05-08T20:56:41.808198+0000","last_unstale":"2024-05-08T20:56:42.787405+0000","last_undegraded":"2024-05-08T20:56:42.787405+0000","last_fullsized":"2024-05-08T20:56:42.787405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273235+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:56:43.273235+0000","last_peered":"2024-05-08T20:56:43.273235+0000","last_clean":"2024-05-08T20:56:43.273235+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:56:43.273235+0000","last_undegraded":"2024-05-08T20:56:43.273235+0000","last_fullsized":"2024-05-08T20:56:43.273235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:42.787094+0000","last_change":"2024-05-08T20:56:41.809061+0000","last_active":"2024-05-08T20:56:42.787094+0000","last_peered":"2024-05-08T20:56:42.787094+0000","last_clean":"2024-05-08T20:56:42.787094+0000","last_became_active":"2024-05-08T20:56:41.808633+0000","last_became_peered":"2024-05-08T20:56:41.808633+0000","last_unstale":"2024-05-08T20:56:42.787094+0000","last_undegraded":"2024-05-08T20:56:42.787094+0000","last_fullsized":"2024-05-08T20:56:42.787094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273650+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T20:56:43.273650+0000","last_peered":"2024-05-08T20:56:43.273650+0000","last_clean":"2024-05-08T20:56:43.273650+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T20:56:43.273650+0000","last_undegraded":"2024-05-08T20:56:43.273650+0000","last_fullsized":"2024-05-08T20:56:43.273650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273560+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T20:56:43.273560+0000","last_peered":"2024-05-08T20:56:43.273560+0000","last_clean":"2024-05-08T20:56:43.273560+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T20:56:43.273560+0000","last_undegraded":"2024-05-08T20:56:43.273560+0000","last_fullsized":"2024-05-08T20:56:43.273560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.274424+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:56:43.274424+0000","last_peered":"2024-05-08T20:56:43.274424+0000","last_clean":"2024-05-08T20:56:43.274424+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:56:43.274424+0000","last_undegraded":"2024-05-08T20:56:43.274424+0000","last_fullsized":"2024-05-08T20:56:43.274424+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T20:56:43.273978+0000","last_peered":"2024-05-08T20:56:43.273978+0000","last_clean":"2024-05-08T20:56:43.273978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T20:56:43.273978+0000","last_undegraded":"2024-05-08T20:56:43.273978+0000","last_fullsized":"2024-05-08T20:56:43.273978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T20:56:43.273990+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:56:43.273990+0000","last_peered":"2024-05-08T20:56:43.273990+0000","last_clean":"2024-05-08T20:56:43.273990+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:56:43.273990+0000","last_undegraded":"2024-05-08T20:56:43.273990+0000","last_fullsized":"2024-05-08T20:56:43.273990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.175}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:56:50.255 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T20:56:50.255 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T20:56:50.255 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T20:56:50.256 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T20:56:50.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 Processor -- start 2024-05-08T20:56:50.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- start start 2024-05-08T20:56:50.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f61f00d1690 0x7f61f00d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00d0f20 0x7f61f00d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f00d1fb0 con 0x7f61f00cf6e0 2024-05-08T20:56:50.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00d3e50 con 0x7f61f00d1690 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00ce870 con 0x7f61f00d0f20 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f56e1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00d0f20 0x7f61f00d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f5ee2700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f61f00d1690 0x7f61f00d37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f66e3700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f61f00cf6e0 0x7f61f00cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50148/0 (socket says 172.21.15.107:50148) 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f66e3700 1 -- 172.21.15.107:0/565855104 learned_addr learned my addr 172.21.15.107:0/565855104 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f5ee2700 1 -- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00d0f20 msgr2=0x7f61f00d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f5ee2700 1 --2- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00d0f20 0x7f61f00d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f5ee2700 1 -- 172.21.15.107:0/565855104 >> v1:172.21.15.195:6789/0 conn(0x7f61f00cf6e0 legacy=0x7f61f00cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f5ee2700 1 -- 172.21.15.107:0/565855104 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f00ceb50 con 0x7f61f00d1690 2024-05-08T20:56:50.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f5ee2700 1 --2- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f00d37c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009d90 tx=0x7f61e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e147446e9763eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f4ee0700 1 -- 172.21.15.107:0/565855104 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000e070 con 0x7f61f00d1690 2024-05-08T20:56:50.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f4ee0700 1 -- 172.21.15.107:0/565855104 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e000bb20 con 0x7f61f00d1690 2024-05-08T20:56:50.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f4ee0700 1 -- 172.21.15.107:0/565855104 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0012430 con 0x7f61f00d1690 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 msgr2=0x7f61f00d37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f00d37c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009d90 tx=0x7f61e000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- 172.21.15.107:0/565855104 shutdown_connections 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00d0f20 0x7f61f00d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/565855104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f00d37c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.352+0000 7f61f6ee4700 1 -- 172.21.15.107:0/565855104 >> 172.21.15.107:0/565855104 conn(0x7f61f009c3c0 msgr2=0x7f61f00d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- 172.21.15.107:0/565855104 shutdown_connections 2024-05-08T20:56:50.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- 172.21.15.107:0/565855104 wait complete. 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 Processor -- start 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- start start 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00cf6e0 0x7f61f00b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f00d0f20 0x7f61f00b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f015da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f015eaa0 con 0x7f61f00d0f20 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f015fa30 con 0x7f61f00d1690 2024-05-08T20:56:50.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f014e360 con 0x7f61f00cf6e0 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f56e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f00d0f20 0x7f61f00b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f015da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:38872/0 (socket says 172.21.15.107:38872) 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 -- 172.21.15.107:0/3570005575 learned_addr learned my addr 172.21.15.107:0/3570005575 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f56e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f00d0f20 0x7f61f00b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50852/0 (socket says 172.21.15.107:50852) 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f5ee2700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00cf6e0 0x7f61f00b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 -- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00cf6e0 msgr2=0x7f61f00b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00cf6e0 0x7f61f00b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 -- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f00d0f20 msgr2=0x7f61f00b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f00d0f20 0x7f61f00b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 -- 172.21.15.107:0/3570005575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0009a70 con 0x7f61f00d1690 2024-05-08T20:56:50.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f66e3700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f015da50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c420 tx=0x7f61e800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8005d90 con 0x7f61f00d1690 2024-05-08T20:56:50.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800ce30 con 0x7f61f00d1690 2024-05-08T20:56:50.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f015e7c0 con 0x7f61f00d1690 2024-05-08T20:56:50.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.356+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80072d0 con 0x7f61f00d1690 2024-05-08T20:56:50.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.360+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f00b6120 con 0x7f61f00d1690 2024-05-08T20:56:50.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.360+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f00b5ca0 con 0x7f61f00d1690 2024-05-08T20:56:50.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.360+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61e8007430 con 0x7f61f00d1690 2024-05-08T20:56:50.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.364+0000 7f61ee7fc700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066730 0x7f61dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.364+0000 7f61f5ee2700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066730 0x7f61dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.364+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61e80839e0 con 0x7f61f00d1690 2024-05-08T20:56:50.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.364+0000 7f61f5ee2700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066730 0x7f61dc068bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000f80 tx=0x7f61e0011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.372+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f61e8050ee0 con 0x7f61f00d1690 2024-05-08T20:56:50.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.560+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f61f00b5ca0 con 0x7f61f00d1690 2024-05-08T20:56:50.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.560+0000 7f61ee7fc700 1 -- 172.21.15.107:0/3570005575 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f61e8017040 con 0x7f61f00d1690 2024-05-08T20:56:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:50.567 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T20:56:50.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066730 msgr2=0x7f61dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066730 0x7f61dc068bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000f80 tx=0x7f61e0011000 comp rx=0 tx=0).stop 2024-05-08T20:56:50.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 msgr2=0x7f61f015da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f015da50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c420 tx=0x7f61e800c730 comp rx=0 tx=0).stop 2024-05-08T20:56:50.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 shutdown_connections 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61f00d1690 0x7f61f015da50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f61f00d0f20 0x7f61f00b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f61dc066730 0x7f61dc068bf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 --2- 172.21.15.107:0/3570005575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f61f00cf6e0 0x7f61f00b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 >> 172.21.15.107:0/3570005575 conn(0x7f61f009c3c0 msgr2=0x7f61f006b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 shutdown_connections 2024-05-08T20:56:50.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.564+0000 7f61f6ee4700 1 -- 172.21.15.107:0/3570005575 wait complete. 2024-05-08T20:56:50.585 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T20:56:50.585 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:50.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 Processor -- start 2024-05-08T20:56:50.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 -- start start 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0a300b3c20 0x7f0a301624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a30071e70 0x7f0a300b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a30158960 con 0x7f0a30165070 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300b1f60 con 0x7f0a30071e70 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a364aa700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a30071120 con 0x7f0a300b3c20 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a30071e70 0x7f0a300b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f0a30071e70 0x7f0a300b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50862/0 (socket says 172.21.15.107:50862) 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 -- 172.21.15.107:0/1840855234 learned_addr learned my addr 172.21.15.107:0/1840855234 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a35ca9700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0a30165070 0x7f0a301654e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32786/0 (socket says 172.21.15.107:32786) 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a354a8700 1 --2- 172.21.15.107:0/1840855234 >> v2:172.21.15.195:3300/0 conn(0x7f0a300b3c20 0x7f0a301624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 -- 172.21.15.107:0/1840855234 >> v2:172.21.15.195:3300/0 conn(0x7f0a300b3c20 msgr2=0x7f0a301624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 --2- 172.21.15.107:0/1840855234 >> v2:172.21.15.195:3300/0 conn(0x7f0a300b3c20 0x7f0a301624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 -- 172.21.15.107:0/1840855234 >> v1:172.21.15.107:6789/0 conn(0x7f0a30165070 legacy=0x7f0a301654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 -- 172.21.15.107:0/1840855234 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300b4540 con 0x7f0a30071e70 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a34ca7700 1 --2- 172.21.15.107:0/1840855234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a30071e70 0x7f0a300b4000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0a3006eba0 tx=0x7f0a24009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcccb88e95b576a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a23fff700 1 -- 172.21.15.107:0/1840855234 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400b8a0 con 0x7f0a30071e70 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a23fff700 1 -- 172.21.15.107:0/1840855234 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2400ba00 con 0x7f0a30071e70 2024-05-08T20:56:50.694 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.684+0000 7f0a23fff700 1 -- 172.21.15.107:0/1840855234 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400bd90 con 0x7f0a30071e70 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 -- 172.21.15.107:0/1840855234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a30071e70 msgr2=0x7f0a300b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 --2- 172.21.15.107:0/1840855234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a30071e70 0x7f0a300b4000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0a3006eba0 tx=0x7f0a24009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 -- 172.21.15.107:0/1840855234 shutdown_connections 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 --2- 172.21.15.107:0/1840855234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a30071e70 0x7f0a300b4000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 --2- 172.21.15.107:0/1840855234 >> v2:172.21.15.195:3300/0 conn(0x7f0a300b3c20 0x7f0a301624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 -- 172.21.15.107:0/1840855234 >> 172.21.15.107:0/1840855234 conn(0x7f0a3006c330 msgr2=0x7f0a3006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 -- 172.21.15.107:0/1840855234 shutdown_connections 2024-05-08T20:56:50.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 -- 172.21.15.107:0/1840855234 wait complete. 2024-05-08T20:56:50.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 Processor -- start 2024-05-08T20:56:50.697 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.688+0000 7f0a364aa700 1 -- start start 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a30071e70 0x7f0a300cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 0x7f0a30144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a30165070 0x7f0a30145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3015b370 con 0x7f0a300b3c20 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a301eb030 con 0x7f0a30165070 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3015b090 con 0x7f0a30071e70 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 0x7f0a30144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 0x7f0a30144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50874/0 (socket says 172.21.15.107:50874) 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 -- 172.21.15.107:0/4153592694 learned_addr learned my addr 172.21.15.107:0/4153592694 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a35ca9700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a30165070 0x7f0a30145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a354a8700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a30071e70 0x7f0a300cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 -- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a30071e70 msgr2=0x7f0a300cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a30071e70 0x7f0a300cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 -- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a30165070 msgr2=0x7f0a30145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a30165070 0x7f0a30145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 -- 172.21.15.107:0/4153592694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a24009570 con 0x7f0a300b3c20 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a35ca9700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a30165070 0x7f0a30145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a34ca7700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 0x7f0a30144cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000c00 tx=0x7f0a24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24003ad0 con 0x7f0a300b3c20 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2401e070 con 0x7f0a300b3c20 2024-05-08T20:56:50.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a301eb2d0 con 0x7f0a300b3c20 2024-05-08T20:56:50.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24003e90 con 0x7f0a300b3c20 2024-05-08T20:56:50.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.692+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300ce220 con 0x7f0a300b3c20 2024-05-08T20:56:50.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.696+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a301eae90 con 0x7f0a300b3c20 2024-05-08T20:56:50.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.696+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a24011420 con 0x7f0a300b3c20 2024-05-08T20:56:50.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.696+0000 7f0a21ffb700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0a14066730 0x7f0a14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:50.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.696+0000 7f0a354a8700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0a14066730 0x7f0a14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:50.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.696+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a24020070 con 0x7f0a300b3c20 2024-05-08T20:56:50.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.696+0000 7f0a354a8700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0a14066730 0x7f0a14068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a300cee80 tx=0x7f0a2c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:50.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.704+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0a301eae90 con 0x7f0a300b3c20 2024-05-08T20:56:50.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.864+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a301eb7f0 con 0x7f0a300b3c20 2024-05-08T20:56:50.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.864+0000 7f0a21ffb700 1 -- 172.21.15.107:0/4153592694 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f0a301eb7f0 con 0x7f0a300b3c20 2024-05-08T20:56:50.873 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:50.873 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:42.773336+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0a14066730 msgr2=0x7f0a14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0a14066730 0x7f0a14068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0a300cee80 tx=0x7f0a2c008040 comp rx=0 tx=0).stop 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 msgr2=0x7f0a30144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 0x7f0a30144cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000c00 tx=0x7f0a24004770 comp rx=0 tx=0).stop 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 shutdown_connections 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a30165070 0x7f0a30145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a300b3c20 0x7f0a30144cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0a14066730 0x7f0a14068bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 --2- 172.21.15.107:0/4153592694 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0a30071e70 0x7f0a300cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 >> 172.21.15.107:0/4153592694 conn(0x7f0a3006c330 msgr2=0x7f0a30163090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:50.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 shutdown_connections 2024-05-08T20:56:50.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.868+0000 7f0a364aa700 1 -- 172.21.15.107:0/4153592694 wait complete. 2024-05-08T20:56:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:56:50.889 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:56:51.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 Processor -- start 2024-05-08T20:56:51.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 -- start start 2024-05-08T20:56:51.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb88160920 0x7feb880ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880d0050 0x7feb880b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880d3d40 con 0x7feb880d1da0 2024-05-08T20:56:51.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880d0d00 con 0x7feb88160920 2024-05-08T20:56:51.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.992+0000 7feb8d3e9700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880d0fe0 con 0x7feb880d0050 2024-05-08T20:56:51.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb87fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb88160920 0x7feb880ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb87fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7feb88160920 0x7feb880ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50888/0 (socket says 172.21.15.107:50888) 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb877fe700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7feb880d1da0 0x7feb880cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50164/0 (socket says 172.21.15.107:50164) 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8cbe8700 1 --2- 172.21.15.107:0/1740622396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880d0050 0x7feb880b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb87fff700 1 -- 172.21.15.107:0/1740622396 learned_addr learned my addr 172.21.15.107:0/1740622396 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8cbe8700 1 -- 172.21.15.107:0/1740622396 >> v2:172.21.15.107:3300/0 conn(0x7feb88160920 msgr2=0x7feb880ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8cbe8700 1 --2- 172.21.15.107:0/1740622396 >> v2:172.21.15.107:3300/0 conn(0x7feb88160920 0x7feb880ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8cbe8700 1 -- 172.21.15.107:0/1740622396 >> v1:172.21.15.195:6789/0 conn(0x7feb880d1da0 legacy=0x7feb880cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb86ffd700 1 -- 172.21.15.107:0/1740622396 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327069439 0 0) 0x7feb880d3d40 con 0x7feb880d1da0 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8cbe8700 1 -- 172.21.15.107:0/1740622396 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880d12c0 con 0x7feb880d0050 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8cbe8700 1 --2- 172.21.15.107:0/1740622396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880d0050 0x7feb880b5e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb80009d90 tx=0x7feb8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b0572af9945a16f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb86ffd700 1 -- 172.21.15.107:0/1740622396 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000e070 con 0x7feb880d0050 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb86ffd700 1 -- 172.21.15.107:0/1740622396 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8000bb20 con 0x7feb880d0050 2024-05-08T20:56:51.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb86ffd700 1 -- 172.21.15.107:0/1740622396 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80012430 con 0x7feb880d0050 2024-05-08T20:56:51.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1740622396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880d0050 msgr2=0x7feb880b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1740622396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880d0050 0x7feb880b5e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb80009d90 tx=0x7feb8000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1740622396 shutdown_connections 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1740622396 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb880d0050 0x7feb880b5e50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1740622396 >> v2:172.21.15.107:3300/0 conn(0x7feb88160920 0x7feb880ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1740622396 >> 172.21.15.107:0/1740622396 conn(0x7feb8809c340 msgr2=0x7feb880d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1740622396 shutdown_connections 2024-05-08T20:56:51.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:50.996+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1740622396 wait complete. 2024-05-08T20:56:51.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 Processor -- start 2024-05-08T20:56:51.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 -- start start 2024-05-08T20:56:51.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 0x7feb88153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb880d1da0 0x7feb881f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb88160920 0x7feb880ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880ca610 con 0x7feb880d0050 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880ca840 con 0x7feb880d1da0 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb880cab20 con 0x7feb88160920 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 0x7feb88153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb877fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb880d1da0 0x7feb881f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 0x7feb88153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50890/0 (socket says 172.21.15.107:50890) 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 -- 172.21.15.107:0/1752000457 learned_addr learned my addr 172.21.15.107:0/1752000457 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8cbe8700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb88160920 0x7feb880ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 -- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb88160920 msgr2=0x7feb880ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb88160920 0x7feb880ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 -- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb880d1da0 msgr2=0x7feb881f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb880d1da0 0x7feb881f0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 -- 172.21.15.107:0/1752000457 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb80009a70 con 0x7feb880d0050 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb87fff700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 0x7feb88153de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e890 tx=0x7feb7800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78009620 con 0x7feb880d0050 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb78013680 con 0x7feb880d0050 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb88160e80 con 0x7feb880d0050 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78013a30 con 0x7feb880d0050 2024-05-08T20:56:51.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.000+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb880cb450 con 0x7feb880d0050 2024-05-08T20:56:51.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.004+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb880cb040 con 0x7feb880d0050 2024-05-08T20:56:51.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.004+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb78013b90 con 0x7feb880d0050 2024-05-08T20:56:51.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.004+0000 7feb84ff9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7feb74066730 0x7feb74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.004+0000 7feb877fe700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7feb74066730 0x7feb74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.004+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb78084090 con 0x7feb880d0050 2024-05-08T20:56:51.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.008+0000 7feb877fe700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7feb74066730 0x7feb74068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb880b7dd0 tx=0x7feb7c007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.012+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7feb880cb040 con 0x7feb880d0050 2024-05-08T20:56:51.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.184+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb880cb2b0 con 0x7feb880d0050 2024-05-08T20:56:51.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.184+0000 7feb84ff9700 1 -- 172.21.15.107:0/1752000457 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb880cb2b0 con 0x7feb880d0050 2024-05-08T20:56:51.193 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7feb74066730 msgr2=0x7feb74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7feb74066730 0x7feb74068bf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb880b7dd0 tx=0x7feb7c007e90 comp rx=0 tx=0).stop 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 msgr2=0x7feb88153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 0x7feb88153de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e890 tx=0x7feb7800eba0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 shutdown_connections 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7feb74066730 0x7feb74068bf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feb88160920 0x7feb880ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb880d1da0 0x7feb881f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 --2- 172.21.15.107:0/1752000457 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feb880d0050 0x7feb88153de0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 >> 172.21.15.107:0/1752000457 conn(0x7feb8809c340 msgr2=0x7feb8806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 shutdown_connections 2024-05-08T20:56:51.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.188+0000 7feb8d3e9700 1 -- 172.21.15.107:0/1752000457 wait complete. 2024-05-08T20:56:51.208 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:56:51.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377f59e700 1 Processor -- start 2024-05-08T20:56:51.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377f59e700 1 -- start start 2024-05-08T20:56:51.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377f59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3780160920 0x7f37800ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377f59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800d3d40 con 0x7f37800d1da0 2024-05-08T20:56:51.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377f59e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800d0d00 con 0x7f37800d0050 2024-05-08T20:56:51.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377f59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800d0fe0 con 0x7f3780160920 2024-05-08T20:56:51.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377dd9b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f37800d1da0 0x7f37800cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32800/0 (socket says 172.21.15.107:32800) 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.320+0000 7f377dd9b700 1 -- 172.21.15.107:0/688176191 learned_addr learned my addr 172.21.15.107:0/688176191 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377e59c700 1 --2- 172.21.15.107:0/688176191 >> v2:172.21.15.195:3300/0 conn(0x7f3780160920 0x7f37800ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418432218 0 0) 0x7f37800d3d40 con 0x7f37800d1da0 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37680035d0 con 0x7f37800d1da0 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658850698 0 0) 0x7f37800d0d00 con 0x7f37800d0050 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37800d3d40 con 0x7f37800d0050 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 455476746 0 0) 0x7f37680035d0 con 0x7f37800d1da0 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 >> v2:172.21.15.195:3300/0 conn(0x7f3780160920 msgr2=0x7f37800ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 --2- 172.21.15.107:0/688176191 >> v2:172.21.15.195:3300/0 conn(0x7f3780160920 0x7f37800ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 >> v1:172.21.15.195:6789/0 conn(0x7f37800d0050 legacy=0x7f37800b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800d12c0 con 0x7f37800d1da0 2024-05-08T20:56:51.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7f3770001670 con 0x7f37800d1da0 2024-05-08T20:56:51.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377e59c700 1 --2- 172.21.15.107:0/688176191 >> v2:172.21.15.195:3300/0 conn(0x7f3780160920 0x7f37800ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:51.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 >> v1:172.21.15.107:6789/0 conn(0x7f37800d1da0 legacy=0x7f37800cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3768003bb0 0x7f3768003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3768004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3768005230 0x7f376800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800d0fe0 con 0x7f3768004870 2024-05-08T20:56:51.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376800c160 con 0x7f3768003bb0 2024-05-08T20:56:51.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376800c320 con 0x7f3768005230 2024-05-08T20:56:51.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3768004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377e59c700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3768003bb0 0x7f3768003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377ed9d700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3768005230 0x7f376800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 -- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3768005230 msgr2=0x7f376800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:51.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3768005230 0x7f376800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 -- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3768003bb0 msgr2=0x7f3768003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3768003bb0 0x7f3768003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 -- 172.21.15.107:0/688176191 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680035d0 con 0x7f3768004870 2024-05-08T20:56:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377ed9d700 1 -- 172.21.15.107:0/688176191 reap_dead start 2024-05-08T20:56:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377e59c700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3768003bb0 0x7f3768003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:51.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377dd9b700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3768004cf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3770001eb0 tx=0x7f37680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4711254ed10d43af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770005980 con 0x7f3768004870 2024-05-08T20:56:51.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770005ae0 con 0x7f3768004870 2024-05-08T20:56:51.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377d59a700 1 -- 172.21.15.107:0/688176191 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770005e90 con 0x7f3768004870 2024-05-08T20:56:51.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 -- 172.21.15.107:0/688176191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 msgr2=0x7f3768004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3768004cf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3770001eb0 tx=0x7f37680058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 -- 172.21.15.107:0/688176191 shutdown_connections 2024-05-08T20:56:51.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 --2- 172.21.15.107:0/688176191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3768004cf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 -- 172.21.15.107:0/688176191 >> 172.21.15.107:0/688176191 conn(0x7f378009c340 msgr2=0x7f37800d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 -- 172.21.15.107:0/688176191 shutdown_connections 2024-05-08T20:56:51.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.324+0000 7f377f59e700 1 -- 172.21.15.107:0/688176191 wait complete. 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 Processor -- start 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 -- start start 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3780158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3780156ea0 0x7f3780157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f378014c3e0 0x7f378014c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c6ac0 con 0x7f3768004870 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378014cda0 con 0x7f3780156ea0 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377f59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3780157960 con 0x7f378014c3e0 2024-05-08T20:56:51.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3780158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3780158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50916/0 (socket says 172.21.15.107:50916) 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 -- 172.21.15.107:0/2086178368 learned_addr learned my addr 172.21.15.107:0/2086178368 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377dd9b700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3780156ea0 0x7f3780157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377ed9d700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f378014c3e0 0x7f378014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 -- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f378014c3e0 msgr2=0x7f378014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f378014c3e0 0x7f378014c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 -- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3780156ea0 msgr2=0x7f3780157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3780156ea0 0x7f3780157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 -- 172.21.15.107:0/2086178368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780160e80 con 0x7f3768004870 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377ed9d700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f378014c3e0 0x7f378014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.328+0000 7f377e59c700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3780158f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3774011860 tx=0x7f3774011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774015870 con 0x7f3768004870 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37740159d0 con 0x7f3768004870 2024-05-08T20:56:51.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3780157c40 con 0x7f3768004870 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774015d40 con 0x7f3768004870 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378014d1a0 con 0x7f3768004870 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f377401d400 con 0x7f3768004870 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780158160 con 0x7f3768004870 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f376effd700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3760066760 0x7f3760068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3774084810 con 0x7f3768004870 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f377dd9b700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3760066760 0x7f3760068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.332+0000 7f377dd9b700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3760066760 0x7f3760068c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3770001eb0 tx=0x7f3770009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.340+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3774051b70 con 0x7f3768004870 2024-05-08T20:56:51.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.500+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37800684b0 con 0x7f3768004870 2024-05-08T20:56:51.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.500+0000 7f376effd700 1 -- 172.21.15.107:0/2086178368 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3774055190 con 0x7f3768004870 2024-05-08T20:56:51.509 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3760066760 msgr2=0x7f3760068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3760066760 0x7f3760068c20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3770001eb0 tx=0x7f3770009000 comp rx=0 tx=0).stop 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 msgr2=0x7f3780158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3780158f80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3774011860 tx=0x7f3774011b70 comp rx=0 tx=0).stop 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 shutdown_connections 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3760066760 0x7f3760068c20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f378014c3e0 0x7f378014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3780156ea0 0x7f3780157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 --2- 172.21.15.107:0/2086178368 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3768004870 0x7f3780158f80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 >> 172.21.15.107:0/2086178368 conn(0x7f378009c340 msgr2=0x7f378015ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 shutdown_connections 2024-05-08T20:56:51.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.504+0000 7f377f59e700 1 -- 172.21.15.107:0/2086178368 wait complete. 2024-05-08T20:56:51.522 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:56:51.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d2776700 1 Processor -- start 2024-05-08T20:56:51.636 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d2776700 1 -- start start 2024-05-08T20:56:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d2776700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc15e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d2776700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc15a350 con 0x7f07cc157b30 2024-05-08T20:56:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d2776700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc15a5b0 con 0x7f07cc0adf30 2024-05-08T20:56:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d2776700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc15e980 con 0x7f07cc0abda0 2024-05-08T20:56:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d1774700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f07cc157b30 0x7f07cc0ad820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32804/0 (socket says 172.21.15.107:32804) 2024-05-08T20:56:51.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d1774700 1 -- 172.21.15.107:0/181939044 learned_addr learned my addr 172.21.15.107:0/181939044 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:51.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07d0f73700 1 --2- 172.21.15.107:0/181939044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc15e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748953332 0 0) 0x7f07cc15a350 con 0x7f07cc157b30 2024-05-08T20:56:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.628+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b80035d0 con 0x7f07cc157b30 2024-05-08T20:56:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744641591 0 0) 0x7f07cc15a5b0 con 0x7f07cc0adf30 2024-05-08T20:56:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc15a350 con 0x7f07cc0adf30 2024-05-08T20:56:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d0f73700 1 -- 172.21.15.107:0/181939044 >> v1:172.21.15.195:6789/0 conn(0x7f07cc0adf30 legacy=0x7f07cc0b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d0f73700 1 -- 172.21.15.107:0/181939044 >> v1:172.21.15.107:6789/0 conn(0x7f07cc157b30 legacy=0x7f07cc0ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d0f73700 1 -- 172.21.15.107:0/181939044 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc15a890 con 0x7f07cc0abda0 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d0f73700 1 --2- 172.21.15.107:0/181939044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc15e350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009880 tx=0x7f07bc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45665bc0f08b9693 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc011830 con 0x7f07cc0abda0 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc011990 con 0x7f07cc0abda0 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07cbfff700 1 -- 172.21.15.107:0/181939044 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc011d20 con 0x7f07cc0abda0 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 -- 172.21.15.107:0/181939044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 msgr2=0x7f07cc15e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 --2- 172.21.15.107:0/181939044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc15e350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009880 tx=0x7f07bc009b90 comp rx=0 tx=0).stop 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 -- 172.21.15.107:0/181939044 shutdown_connections 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 --2- 172.21.15.107:0/181939044 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc15e350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 -- 172.21.15.107:0/181939044 >> 172.21.15.107:0/181939044 conn(0x7f07cc0b0de0 msgr2=0x7f07cc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 -- 172.21.15.107:0/181939044 shutdown_connections 2024-05-08T20:56:51.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 -- 172.21.15.107:0/181939044 wait complete. 2024-05-08T20:56:51.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 Processor -- start 2024-05-08T20:56:51.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.632+0000 7f07d2776700 1 -- start start 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 0x7f07cc09bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07cc157b30 0x7f07cc150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc159f00 con 0x7f07cc0adf30 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1f1a60 con 0x7f07cc157b30 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1f1d40 con 0x7f07cc0abda0 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 0x7f07cc09bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 0x7f07cc09bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50926/0 (socket says 172.21.15.107:50926) 2024-05-08T20:56:51.644 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 -- 172.21.15.107:0/3114421844 learned_addr learned my addr 172.21.15.107:0/3114421844 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d1f75700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07cc157b30 0x7f07cc150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d1774700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 -- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 msgr2=0x7f07cc1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 -- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07cc157b30 msgr2=0x7f07cc150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07cc157b30 0x7f07cc150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 -- 172.21.15.107:0/3114421844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0094b0 con 0x7f07cc0adf30 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d1f75700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07cc157b30 0x7f07cc150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:51.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d0f73700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 0x7f07cc09bfa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f07bc013040 tx=0x7f07bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0198d0 con 0x7f07cc0adf30 2024-05-08T20:56:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc01e070 con 0x7f07cc0adf30 2024-05-08T20:56:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc1f2020 con 0x7f07cc0adf30 2024-05-08T20:56:51.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc019c50 con 0x7f07cc0adf30 2024-05-08T20:56:51.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc157fa0 con 0x7f07cc0adf30 2024-05-08T20:56:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.636+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc1f2540 con 0x7f07cc0adf30 2024-05-08T20:56:51.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.640+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07bc02d450 con 0x7f07cc0adf30 2024-05-08T20:56:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.640+0000 7f07c9ffb700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07ac066730 0x7f07ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.640+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07bc085360 con 0x7f07cc0adf30 2024-05-08T20:56:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.640+0000 7f07d1774700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07ac066730 0x7f07ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.649 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.640+0000 7f07d1774700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07ac066730 0x7f07ac068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07c40012e0 tx=0x7f07c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.654 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.648+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f07bc052810 con 0x7f07cc0adf30 2024-05-08T20:56:51.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.796+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07cc1f2540 con 0x7f07cc0adf30 2024-05-08T20:56:51.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.796+0000 7f07c9ffb700 1 -- 172.21.15.107:0/3114421844 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07bc020020 con 0x7f07cc0adf30 2024-05-08T20:56:51.805 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T20:56:51.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07ac066730 msgr2=0x7f07ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07ac066730 0x7f07ac068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f07c40012e0 tx=0x7f07c4009040 comp rx=0 tx=0).stop 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 msgr2=0x7f07cc09bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 0x7f07cc09bfa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f07bc013040 tx=0x7f07bc004770 comp rx=0 tx=0).stop 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 shutdown_connections 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f07cc157b30 0x7f07cc150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f07cc0adf30 0x7f07cc09bfa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f07ac066730 0x7f07ac068bf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 --2- 172.21.15.107:0/3114421844 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f07cc0abda0 0x7f07cc1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 >> 172.21.15.107:0/3114421844 conn(0x7f07cc0b0de0 msgr2=0x7f07cc0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 shutdown_connections 2024-05-08T20:56:51.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.800+0000 7f07d2776700 1 -- 172.21.15.107:0/3114421844 wait complete. 2024-05-08T20:56:51.819 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:51.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 Processor -- start 2024-05-08T20:56:51.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- start start 2024-05-08T20:56:51.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ab80ce510 0x7f9ab815a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab815aaa0 0x7f9ab813d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab80ce080 con 0x7f9ab8071ab0 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab80cd7c0 con 0x7f9ab80ce510 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80cda30 con 0x7f9ab815aaa0 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ab80ce510 0x7f9ab815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9ab80ce510 0x7f9ab815a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50930/0 (socket says 172.21.15.107:50930) 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 -- 172.21.15.107:0/8269931 learned_addr learned my addr 172.21.15.107:0/8269931 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 -- 172.21.15.107:0/8269931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab815aaa0 msgr2=0x7f9ab813d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 --2- 172.21.15.107:0/8269931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab815aaa0 0x7f9ab813d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 -- 172.21.15.107:0/8269931 >> v1:172.21.15.195:6789/0 conn(0x7f9ab8071ab0 legacy=0x7f9ab8071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:51.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 -- 172.21.15.107:0/8269931 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab80cdd10 con 0x7f9ab80ce510 2024-05-08T20:56:51.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab77fe700 1 --2- 172.21.15.107:0/8269931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab80ce510 0x7f9ab815a560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009910 tx=0x7f9aa0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2535ee825aa4210b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab6ffd700 1 -- 172.21.15.107:0/8269931 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0004230 con 0x7f9ab80ce510 2024-05-08T20:56:51.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab6ffd700 1 -- 172.21.15.107:0/8269931 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa0004390 con 0x7f9ab80ce510 2024-05-08T20:56:51.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9ab6ffd700 1 -- 172.21.15.107:0/8269931 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0009e60 con 0x7f9ab80ce510 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- 172.21.15.107:0/8269931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab80ce510 msgr2=0x7f9ab815a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/8269931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab80ce510 0x7f9ab815a560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009910 tx=0x7f9aa0009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- 172.21.15.107:0/8269931 shutdown_connections 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/8269931 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab815aaa0 0x7f9ab813d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/8269931 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab80ce510 0x7f9ab815a560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- 172.21.15.107:0/8269931 >> 172.21.15.107:0/8269931 conn(0x7f9ab806c330 msgr2=0x7f9ab806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- 172.21.15.107:0/8269931 shutdown_connections 2024-05-08T20:56:51.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.916+0000 7f9abd1a5700 1 -- 172.21.15.107:0/8269931 wait complete. 2024-05-08T20:56:51.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 Processor -- start 2024-05-08T20:56:51.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 -- start start 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab8071ab0 0x7f9ab8151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 0x7f9ab8143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8140680 0x7f9ab815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8144990 con 0x7f9ab815aaa0 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab813bdd0 con 0x7f9ab8140680 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abd1a5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8152470 con 0x7f9ab8071ab0 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 0x7f9ab8143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 0x7f9ab8143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50932/0 (socket says 172.21.15.107:50932) 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 -- 172.21.15.107:0/2409864011 learned_addr learned my addr 172.21.15.107:0/2409864011 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9abc9a4700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8140680 0x7f9ab815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab7fff700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab8071ab0 0x7f9ab8151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 -- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab8071ab0 msgr2=0x7f9ab8151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab8071ab0 0x7f9ab8151f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 -- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8140680 msgr2=0x7f9ab815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8140680 0x7f9ab815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.920+0000 7f9ab77fe700 1 -- 172.21.15.107:0/2409864011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0009570 con 0x7f9ab815aaa0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab77fe700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 0x7f9ab8143b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009860 tx=0x7f9aa0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000bc50 con 0x7f9ab815aaa0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa001f070 con 0x7f9ab815aaa0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab81443d0 con 0x7f9ab815aaa0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00036c0 con 0x7f9ab815aaa0 2024-05-08T20:56:51.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab813ba60 con 0x7f9ab815aaa0 2024-05-08T20:56:51.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab813b8c0 con 0x7f9ab815aaa0 2024-05-08T20:56:51.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9aa0021030 con 0x7f9ab815aaa0 2024-05-08T20:56:51.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab4ff9700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9a9c066730 0x7f9a9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:51.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab7fff700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9a9c066730 0x7f9a9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:51.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.924+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9aa0085570 con 0x7f9ab815aaa0 2024-05-08T20:56:51.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.928+0000 7f9ab7fff700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9a9c066730 0x7f9a9c068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8007fd0 tx=0x7f9aa8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:51.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:51.932+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9ab813b8c0 con 0x7f9ab815aaa0 2024-05-08T20:56:52.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.140+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ab813b8c0 con 0x7f9ab815aaa0 2024-05-08T20:56:52.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9ab4ff9700 1 -- 172.21.15.107:0/2409864011 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f9ab813b8c0 con 0x7f9ab815aaa0 2024-05-08T20:56:52.151 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:52.151 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:56:41.769074+0000","modified":"2024-05-08T20:56:44.783973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:56:52.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9a9c066730 msgr2=0x7f9a9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9a9c066730 0x7f9a9c068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8007fd0 tx=0x7f9aa8009040 comp rx=0 tx=0).stop 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 msgr2=0x7f9ab8143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 0x7f9ab8143b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009860 tx=0x7f9aa0004770 comp rx=0 tx=0).stop 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 shutdown_connections 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8140680 0x7f9ab815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9ab815aaa0 0x7f9ab8143b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9a9c066730 0x7f9a9c068bf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 --2- 172.21.15.107:0/2409864011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9ab8071ab0 0x7f9ab8151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 >> 172.21.15.107:0/2409864011 conn(0x7f9ab806c330 msgr2=0x7f9ab806ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 shutdown_connections 2024-05-08T20:56:52.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.144+0000 7f9abd1a5700 1 -- 172.21.15.107:0/2409864011 wait complete. 2024-05-08T20:56:52.155 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-05-08T20:56:52.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:52.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.268+0000 7fd607fff700 1 Processor -- start 2024-05-08T20:56:52.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.268+0000 7fd607fff700 1 -- start start 2024-05-08T20:56:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd60815ac70 0x7fd60813d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080ce080 con 0x7fd608071ab0 2024-05-08T20:56:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080cd7c0 con 0x7fd6080ce510 2024-05-08T20:56:52.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080cda30 con 0x7fd60815ac70 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd606ffd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd608071ab0 0x7fd608071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32812/0 (socket says 172.21.15.107:32812) 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd606ffd700 1 -- 172.21.15.107:0/2912582887 learned_addr learned my addr 172.21.15.107:0/2912582887 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd6077fe700 1 --2- 172.21.15.107:0/2912582887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd60815ac70 0x7fd60813d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd605ffb700 1 -- 172.21.15.107:0/2912582887 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532494433 0 0) 0x7fd6080ce080 con 0x7fd608071ab0 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd605ffb700 1 -- 172.21.15.107:0/2912582887 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f40035d0 con 0x7fd608071ab0 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd605ffb700 1 -- 172.21.15.107:0/2912582887 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026073754 0 0) 0x7fd6080cd7c0 con 0x7fd6080ce510 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd6077fe700 1 -- 172.21.15.107:0/2912582887 >> v1:172.21.15.195:6789/0 conn(0x7fd6080ce510 legacy=0x7fd60815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd6077fe700 1 -- 172.21.15.107:0/2912582887 >> v1:172.21.15.107:6789/0 conn(0x7fd608071ab0 legacy=0x7fd608071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd6077fe700 1 -- 172.21.15.107:0/2912582887 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080cdd10 con 0x7fd60815ac70 2024-05-08T20:56:52.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd6077fe700 1 --2- 172.21.15.107:0/2912582887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd60815ac70 0x7fd60813d500 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd600009dc0 tx=0x7fd60000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87ff0aacd231b267 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd605ffb700 1 -- 172.21.15.107:0/2912582887 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000e070 con 0x7fd60815ac70 2024-05-08T20:56:52.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd605ffb700 1 -- 172.21.15.107:0/2912582887 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60000bb20 con 0x7fd60815ac70 2024-05-08T20:56:52.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd605ffb700 1 -- 172.21.15.107:0/2912582887 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000be90 con 0x7fd60815ac70 2024-05-08T20:56:52.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- 172.21.15.107:0/2912582887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd60815ac70 msgr2=0x7fd60813d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 --2- 172.21.15.107:0/2912582887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd60815ac70 0x7fd60813d500 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd600009dc0 tx=0x7fd60000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- 172.21.15.107:0/2912582887 shutdown_connections 2024-05-08T20:56:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 --2- 172.21.15.107:0/2912582887 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd60815ac70 0x7fd60813d500 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- 172.21.15.107:0/2912582887 >> 172.21.15.107:0/2912582887 conn(0x7fd60806c330 msgr2=0x7fd60806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- 172.21.15.107:0/2912582887 shutdown_connections 2024-05-08T20:56:52.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.272+0000 7fd607fff700 1 -- 172.21.15.107:0/2912582887 wait complete. 2024-05-08T20:56:52.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 Processor -- start 2024-05-08T20:56:52.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 -- start start 2024-05-08T20:56:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 0x7fd6081f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6080ce510 0x7fd608156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd60815ac70 0x7fd6080c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081422a0 con 0x7fd608071ab0 2024-05-08T20:56:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608157680 con 0x7fd60815ac70 2024-05-08T20:56:52.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd608142540 con 0x7fd6080ce510 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 0x7fd6081f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd6067fc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6080ce510 0x7fd608156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 0x7fd6081f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50938/0 (socket says 172.21.15.107:50938) 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 -- 172.21.15.107:0/806199216 learned_addr learned my addr 172.21.15.107:0/806199216 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd6077fe700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd60815ac70 0x7fd6080c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 -- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6080ce510 msgr2=0x7fd608156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6080ce510 0x7fd608156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 -- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd60815ac70 msgr2=0x7fd6080c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd60815ac70 0x7fd6080c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 -- 172.21.15.107:0/806199216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009a70 con 0x7fd608071ab0 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd606ffd700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 0x7fd6081f5670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c4f0 tx=0x7fd5f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8005d90 con 0x7fd608071ab0 2024-05-08T20:56:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd608142820 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd608157250 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f80070d0 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.276+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8007440 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.280+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec005310 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.280+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5f80075a0 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.280+0000 7fd5fffff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd5e8066760 0x7fd5e8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.280+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5f8083430 con 0x7fd608071ab0 2024-05-08T20:56:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.280+0000 7fd6067fc700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd5e8066760 0x7fd5e8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.280+0000 7fd6067fc700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd5e8066760 0x7fd5e8068c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd60815ce10 tx=0x7fd5f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.284+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd5f80507c0 con 0x7fd608071ab0 2024-05-08T20:56:52.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.460+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5ec0055c0 con 0x7fd608071ab0 2024-05-08T20:56:52.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.460+0000 7fd5fffff700 1 -- 172.21.15.107:0/806199216 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fd5f8053de0 con 0x7fd608071ab0 2024-05-08T20:56:52.470 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:52.470 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:42.773336+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:52.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd5e8066760 msgr2=0x7fd5e8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd5e8066760 0x7fd5e8068c20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd60815ce10 tx=0x7fd5f0009040 comp rx=0 tx=0).stop 2024-05-08T20:56:52.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 msgr2=0x7fd6081f5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 0x7fd6081f5670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c4f0 tx=0x7fd5f800c800 comp rx=0 tx=0).stop 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 shutdown_connections 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd60815ac70 0x7fd6080c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd5e8066760 0x7fd5e8068c20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6080ce510 0x7fd608156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 --2- 172.21.15.107:0/806199216 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd608071ab0 0x7fd6081f5670 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 >> 172.21.15.107:0/806199216 conn(0x7fd60806c330 msgr2=0x7fd608071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 shutdown_connections 2024-05-08T20:56:52.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.464+0000 7fd607fff700 1 -- 172.21.15.107:0/806199216 wait complete. 2024-05-08T20:56:52.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:56:52.490 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:56:52.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 Processor -- start 2024-05-08T20:56:52.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 -- start start 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 0x7f0af006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0af006d150 0x7f0af00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00b1df0 con 0x7f0af01594d0 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00ae330 con 0x7f0af006d150 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af61fe700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00ae140 con 0x7f0af0071a70 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 0x7f0af006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af59fd700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0af006d150 0x7f0af00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 0x7f0af006cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:54188/0 (socket says 172.21.15.107:54188) 2024-05-08T20:56:52.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 -- 172.21.15.107:0/1046507857 learned_addr learned my addr 172.21.15.107:0/1046507857 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:52.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 -- 172.21.15.107:0/1046507857 >> v2:172.21.15.195:3300/0 conn(0x7f0af006d150 msgr2=0x7f0af00b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:52.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 --2- 172.21.15.107:0/1046507857 >> v2:172.21.15.195:3300/0 conn(0x7f0af006d150 0x7f0af00b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 -- 172.21.15.107:0/1046507857 >> v1:172.21.15.195:6789/0 conn(0x7f0af01594d0 legacy=0x7f0af00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.600+0000 7f0af49fb700 1 -- 172.21.15.107:0/1046507857 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00b20d0 con 0x7f0af0071a70 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af49fb700 1 --2- 172.21.15.107:0/1046507857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 0x7f0af006cc10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009910 tx=0x7f0aec009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fface378606442ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0ae3fff700 1 -- 172.21.15.107:0/1046507857 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec011830 con 0x7f0af0071a70 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0ae3fff700 1 -- 172.21.15.107:0/1046507857 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec011990 con 0x7f0af0071a70 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0ae3fff700 1 -- 172.21.15.107:0/1046507857 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec011d40 con 0x7f0af0071a70 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 -- 172.21.15.107:0/1046507857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 msgr2=0x7f0af006cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 --2- 172.21.15.107:0/1046507857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 0x7f0af006cc10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009910 tx=0x7f0aec009c20 comp rx=0 tx=0).stop 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 -- 172.21.15.107:0/1046507857 shutdown_connections 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 --2- 172.21.15.107:0/1046507857 >> v2:172.21.15.195:3300/0 conn(0x7f0af006d150 0x7f0af00b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 --2- 172.21.15.107:0/1046507857 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af0071a70 0x7f0af006cc10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 -- 172.21.15.107:0/1046507857 >> 172.21.15.107:0/1046507857 conn(0x7f0af00b0de0 msgr2=0x7f0af00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 -- 172.21.15.107:0/1046507857 shutdown_connections 2024-05-08T20:56:52.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 -- 172.21.15.107:0/1046507857 wait complete. 2024-05-08T20:56:52.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 Processor -- start 2024-05-08T20:56:52.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.604+0000 7f0af61fe700 1 -- start start 2024-05-08T20:56:52.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af006d150 0x7f0af0156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0071a70 0x7f0af0149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 0x7f0af00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af015b520 con 0x7f0af01594d0 2024-05-08T20:56:52.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af015b320 con 0x7f0af0071a70 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0149fa0 con 0x7f0af006d150 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 0x7f0af00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 0x7f0af00b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50944/0 (socket says 172.21.15.107:50944) 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 -- 172.21.15.107:0/2435330062 learned_addr learned my addr 172.21.15.107:0/2435330062 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af51fc700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af006d150 0x7f0af0156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af49fb700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0071a70 0x7f0af0149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 -- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af006d150 msgr2=0x7f0af0156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af006d150 0x7f0af0156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 -- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0071a70 msgr2=0x7f0af0149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0071a70 0x7f0af0149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 -- 172.21.15.107:0/2435330062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec009570 con 0x7f0af01594d0 2024-05-08T20:56:52.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af59fd700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 0x7f0af00b33a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800efc0 tx=0x7f0ae800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8009ea0 con 0x7f0af01594d0 2024-05-08T20:56:52.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x7f0af01594d0 2024-05-08T20:56:52.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af014a280 con 0x7f0af01594d0 2024-05-08T20:56:52.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800ced0 con 0x7f0af01594d0 2024-05-08T20:56:52.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af014a840 con 0x7f0af01594d0 2024-05-08T20:56:52.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.608+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af00684b0 con 0x7f0af01594d0 2024-05-08T20:56:52.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.612+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ae8014480 con 0x7f0af01594d0 2024-05-08T20:56:52.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.612+0000 7f0ae1ffb700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0ad4066730 0x7f0ad4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.612+0000 7f0af51fc700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0ad4066730 0x7f0ad4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.612+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ae8084c30 con 0x7f0af01594d0 2024-05-08T20:56:52.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.612+0000 7f0af51fc700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0ad4066730 0x7f0ad4068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000f60 tx=0x7f0ae4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.616+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0ae8052040 con 0x7f0af01594d0 2024-05-08T20:56:52.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.788+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0af00667c0 con 0x7f0af01594d0 2024-05-08T20:56:52.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.788+0000 7f0ae1ffb700 1 -- 172.21.15.107:0/2435330062 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ae8018070 con 0x7f0af01594d0 2024-05-08T20:56:52.797 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0ad4066730 msgr2=0x7f0ad4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0ad4066730 0x7f0ad4068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4000f60 tx=0x7f0ae4009040 comp rx=0 tx=0).stop 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 msgr2=0x7f0af00b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 0x7f0af00b33a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800efc0 tx=0x7f0ae800c3a0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 shutdown_connections 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af01594d0 0x7f0af00b33a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0af0071a70 0x7f0af0149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0ad4066730 0x7f0ad4068bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 --2- 172.21.15.107:0/2435330062 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0af006d150 0x7f0af0156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 >> 172.21.15.107:0/2435330062 conn(0x7f0af00b0de0 msgr2=0x7f0af006c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:52.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 shutdown_connections 2024-05-08T20:56:52.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.792+0000 7f0af61fe700 1 -- 172.21.15.107:0/2435330062 wait complete. 2024-05-08T20:56:52.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:56:52.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 Processor -- start 2024-05-08T20:56:52.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 -- start start 2024-05-08T20:56:52.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f04b00e3b40 0x7f04b00e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04b00e0250 0x7f04b00e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b0038ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00e49a0 con 0x7f04b00e0250 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00540b0 con 0x7f04b00e3b40 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04bd8dc700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00532f0 con 0x7f04b0006150 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04b7fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04b00e0250 0x7f04b00e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04b7fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04b00e0250 0x7f04b00e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50950/0 (socket says 172.21.15.107:50950) 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.924+0000 7f04b7fff700 1 -- 172.21.15.107:0/1666398617 learned_addr learned my addr 172.21.15.107:0/1666398617 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd0db700 1 --2- 172.21.15.107:0/1666398617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b0038ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bc8da700 1 --2- 172.21.15.107:0/1666398617 >> v2:172.21.15.195:3300/0 conn(0x7f04b00e3b40 0x7f04b00e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b7fff700 1 -- 172.21.15.107:0/1666398617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 msgr2=0x7f04b0038ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b7fff700 1 --2- 172.21.15.107:0/1666398617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b0038ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b7fff700 1 -- 172.21.15.107:0/1666398617 >> v2:172.21.15.195:3300/0 conn(0x7f04b00e3b40 msgr2=0x7f04b00e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b7fff700 1 --2- 172.21.15.107:0/1666398617 >> v2:172.21.15.195:3300/0 conn(0x7f04b00e3b40 0x7f04b00e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b7fff700 1 -- 172.21.15.107:0/1666398617 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00535d0 con 0x7f04b00e0250 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bc8da700 1 --2- 172.21.15.107:0/1666398617 >> v2:172.21.15.195:3300/0 conn(0x7f04b00e3b40 0x7f04b00e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:56:52.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b7fff700 1 --2- 172.21.15.107:0/1666398617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e0250 0x7f04b00e4460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04b000d990 tx=0x7f04ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dbc02cd0e00e39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b77fe700 1 -- 172.21.15.107:0/1666398617 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00b8a0 con 0x7f04b00e0250 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b77fe700 1 -- 172.21.15.107:0/1666398617 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac00ba00 con 0x7f04b00e0250 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04b77fe700 1 -- 172.21.15.107:0/1666398617 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00bd90 con 0x7f04b00e0250 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 -- 172.21.15.107:0/1666398617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e0250 msgr2=0x7f04b00e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/1666398617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e0250 0x7f04b00e4460 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f04b000d990 tx=0x7f04ac009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 -- 172.21.15.107:0/1666398617 shutdown_connections 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/1666398617 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b0038ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/1666398617 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e0250 0x7f04b00e4460 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/1666398617 >> v2:172.21.15.195:3300/0 conn(0x7f04b00e3b40 0x7f04b00e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 -- 172.21.15.107:0/1666398617 >> 172.21.15.107:0/1666398617 conn(0x7f04b0054b70 msgr2=0x7f04b0054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 -- 172.21.15.107:0/1666398617 shutdown_connections 2024-05-08T20:56:52.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 -- 172.21.15.107:0/1666398617 wait complete. 2024-05-08T20:56:52.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 Processor -- start 2024-05-08T20:56:52.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.928+0000 7f04bd8dc700 1 -- start start 2024-05-08T20:56:52.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b00e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 0x7f04b0049c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04b00da1c0 0x7f04b01773d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00db390 con 0x7f04b00e3b40 2024-05-08T20:56:52.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00e3050 con 0x7f04b00da1c0 2024-05-08T20:56:52.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00da780 con 0x7f04b0006150 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 0x7f04b0049c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 0x7f04b0049c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50952/0 (socket says 172.21.15.107:50952) 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 -- 172.21.15.107:0/2893926528 learned_addr learned my addr 172.21.15.107:0/2893926528 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bc8da700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b00e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd0db700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04b00da1c0 0x7f04b01773d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 -- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 msgr2=0x7f04b00e2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b00e2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 -- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04b00da1c0 msgr2=0x7f04b01773d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04b00da1c0 0x7f04b01773d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 -- 172.21.15.107:0/2893926528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac009570 con 0x7f04b00e3b40 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b7fff700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 0x7f04b0049c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04ac000c00 tx=0x7f04ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0038c0 con 0x7f04b00e3b40 2024-05-08T20:56:52.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac01e070 con 0x7f04b00e3b40 2024-05-08T20:56:52.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ac003c80 con 0x7f04b00e3b40 2024-05-08T20:56:52.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b00daa60 con 0x7f04b00e3b40 2024-05-08T20:56:52.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b00db020 con 0x7f04b00e3b40 2024-05-08T20:56:52.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.932+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00db520 con 0x7f04b00e3b40 2024-05-08T20:56:52.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.936+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04ac011420 con 0x7f04b00e3b40 2024-05-08T20:56:52.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.936+0000 7f04b57fa700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f049c066730 0x7f049c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:52.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.936+0000 7f04bc8da700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f049c066730 0x7f049c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:52.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.936+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04ac020070 con 0x7f04b00e3b40 2024-05-08T20:56:52.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.936+0000 7f04bc8da700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f049c066730 0x7f049c068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04a400ab60 tx=0x7f04a4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:52.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:52.944+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f04ac052bc0 con 0x7f04b00e3b40 2024-05-08T20:56:53.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.116+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04b0005440 con 0x7f04b00e3b40 2024-05-08T20:56:53.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.116+0000 7f04b57fa700 1 -- 172.21.15.107:0/2893926528 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04ac0561e0 con 0x7f04b00e3b40 2024-05-08T20:56:53.125 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f049c066730 msgr2=0x7f049c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f049c066730 0x7f049c068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04a400ab60 tx=0x7f04a4008040 comp rx=0 tx=0).stop 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 msgr2=0x7f04b0049c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 0x7f04b0049c00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04ac000c00 tx=0x7f04ac004770 comp rx=0 tx=0).stop 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 shutdown_connections 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04b00da1c0 0x7f04b01773d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04b00e3b40 0x7f04b0049c00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f049c066730 0x7f049c068bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 --2- 172.21.15.107:0/2893926528 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04b0006150 0x7f04b00e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 >> 172.21.15.107:0/2893926528 conn(0x7f04b0054b70 msgr2=0x7f04b0036b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:53.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 shutdown_connections 2024-05-08T20:56:53.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.120+0000 7f04bd8dc700 1 -- 172.21.15.107:0/2893926528 wait complete. 2024-05-08T20:56:53.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:56:53.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.248+0000 7f132359e700 1 Processor -- start 2024-05-08T20:56:53.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.248+0000 7f132359e700 1 -- start start 2024-05-08T20:56:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f13240ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f132415ead0 0x7f13240cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f13240ce4f0 0x7f13240b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240ce9a0 con 0x7f13240ce4f0 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f132406c7d0 con 0x7f132415ead0 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132406c4d0 con 0x7f132415ae10 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f13240ce4f0 0x7f13240b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f13240ce4f0 0x7f13240b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50966/0 (socket says 172.21.15.107:50966) 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 -- 172.21.15.107:0/3490101503 learned_addr learned my addr 172.21.15.107:0/3490101503 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1321d9b700 1 --2- 172.21.15.107:0/3490101503 >> v2:172.21.15.195:3300/0 conn(0x7f132415ead0 0x7f13240cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132259c700 1 --2- 172.21.15.107:0/3490101503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f13240ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 -- 172.21.15.107:0/3490101503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 msgr2=0x7f13240ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 --2- 172.21.15.107:0/3490101503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f13240ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 -- 172.21.15.107:0/3490101503 >> v2:172.21.15.195:3300/0 conn(0x7f132415ead0 msgr2=0x7f13240cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 --2- 172.21.15.107:0/3490101503 >> v2:172.21.15.195:3300/0 conn(0x7f132415ead0 0x7f13240cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 -- 172.21.15.107:0/3490101503 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240acd90 con 0x7f13240ce4f0 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f1322d9d700 1 --2- 172.21.15.107:0/3490101503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13240ce4f0 0x7f13240b2dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13240b1900 tx=0x7f131c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bbc5b352730eeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132159a700 1 -- 172.21.15.107:0/3490101503 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00e070 con 0x7f13240ce4f0 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132159a700 1 -- 172.21.15.107:0/3490101503 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00b910 con 0x7f13240ce4f0 2024-05-08T20:56:53.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132159a700 1 -- 172.21.15.107:0/3490101503 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00bcc0 con 0x7f13240ce4f0 2024-05-08T20:56:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- 172.21.15.107:0/3490101503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13240ce4f0 msgr2=0x7f13240b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- 172.21.15.107:0/3490101503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13240ce4f0 0x7f13240b2dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13240b1900 tx=0x7f131c00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- 172.21.15.107:0/3490101503 shutdown_connections 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- 172.21.15.107:0/3490101503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13240ce4f0 0x7f13240b2dd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- 172.21.15.107:0/3490101503 >> v2:172.21.15.195:3300/0 conn(0x7f132415ead0 0x7f13240cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 --2- 172.21.15.107:0/3490101503 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f13240ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- 172.21.15.107:0/3490101503 >> 172.21.15.107:0/3490101503 conn(0x7f13240b0de0 msgr2=0x7f13240b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- 172.21.15.107:0/3490101503 shutdown_connections 2024-05-08T20:56:53.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.252+0000 7f132359e700 1 -- 172.21.15.107:0/3490101503 wait complete. 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 Processor -- start 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 -- start start 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13240ce4f0 0x7f13241538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f132409b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 0x7f1324070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1324153e00 con 0x7f132415ead0 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132409baf0 con 0x7f13240ce4f0 2024-05-08T20:56:53.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f132359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240713f0 con 0x7f132415ae10 2024-05-08T20:56:53.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f1322d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 0x7f1324070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.256+0000 7f1322d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 0x7f1324070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50970/0 (socket says 172.21.15.107:50970) 2024-05-08T20:56:53.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 -- 172.21.15.107:0/287876181 learned_addr learned my addr 172.21.15.107:0/287876181 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:53.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1321d9b700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f132409b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f132259c700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13240ce4f0 0x7f13241538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 -- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 msgr2=0x7f132409b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f132409b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 -- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13240ce4f0 msgr2=0x7f13241538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13240ce4f0 0x7f13241538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 -- 172.21.15.107:0/287876181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009b30 con 0x7f132415ead0 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1321d9b700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f132409b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f132259c700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13240ce4f0 0x7f13241538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1322d9d700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 0x7f1324070eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b680 tx=0x7f131c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0099b0 con 0x7f132415ead0 2024-05-08T20:56:53.269 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c0092e0 con 0x7f132415ead0 2024-05-08T20:56:53.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132409bdd0 con 0x7f132415ead0 2024-05-08T20:56:53.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c004470 con 0x7f132415ead0 2024-05-08T20:56:53.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13240c89e0 con 0x7f132415ead0 2024-05-08T20:56:53.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13240684b0 con 0x7f132415ead0 2024-05-08T20:56:53.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.260+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f131c0045d0 con 0x7f132415ead0 2024-05-08T20:56:53.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.264+0000 7f1312ffd700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1304066730 0x7f1304068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.264+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f131c085570 con 0x7f132415ead0 2024-05-08T20:56:53.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.264+0000 7f132259c700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1304066730 0x7f1304068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.264+0000 7f132259c700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1304066730 0x7f1304068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1318009df0 tx=0x7f1318008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.272+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f131c0562e0 con 0x7f132415ead0 2024-05-08T20:56:53.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.440+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13240cb930 con 0x7f132415ead0 2024-05-08T20:56:53.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.440+0000 7f1312ffd700 1 -- 172.21.15.107:0/287876181 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f131c055e70 con 0x7f132415ead0 2024-05-08T20:56:53.450 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T20:56:53.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1304066730 msgr2=0x7f1304068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1304066730 0x7f1304068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1318009df0 tx=0x7f1318008040 comp rx=0 tx=0).stop 2024-05-08T20:56:53.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 msgr2=0x7f1324070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 0x7f1324070eb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b680 tx=0x7f131c004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 shutdown_connections 2024-05-08T20:56:53.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f132415ead0 0x7f1324070eb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1304066730 0x7f1304068bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f132415ae10 0x7f132409b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 --2- 172.21.15.107:0/287876181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13240ce4f0 0x7f13241538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 >> 172.21.15.107:0/287876181 conn(0x7f13240b0de0 msgr2=0x7f132406cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 shutdown_connections 2024-05-08T20:56:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.444+0000 7f132359e700 1 -- 172.21.15.107:0/287876181 wait complete. 2024-05-08T20:56:53.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:53.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 Processor -- start 2024-05-08T20:56:53.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- start start 2024-05-08T20:56:53.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7e140b3300 0x7f7e140b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7e14071110 0x7f7e140715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140b2e10 con 0x7f7e14146b30 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e14146f10 con 0x7f7e140b3300 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140b3cb0 con 0x7f7e14071110 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e137fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7e14146b30 0x7f7e140b2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32818/0 (socket says 172.21.15.107:32818) 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e137fe700 1 -- 172.21.15.107:0/1040573989 learned_addr learned my addr 172.21.15.107:0/1040573989 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/1040573989 >> v2:172.21.15.107:3300/0 conn(0x7f7e140b3300 0x7f7e140b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e13fff700 1 --2- 172.21.15.107:0/1040573989 >> v2:172.21.15.195:3300/0 conn(0x7f7e14071110 0x7f7e140715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e12ffd700 1 -- 172.21.15.107:0/1040573989 >> v2:172.21.15.195:3300/0 conn(0x7f7e14071110 msgr2=0x7f7e140715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/1040573989 >> v2:172.21.15.195:3300/0 conn(0x7f7e14071110 0x7f7e140715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e12ffd700 1 -- 172.21.15.107:0/1040573989 >> v1:172.21.15.107:6789/0 conn(0x7f7e14146b30 legacy=0x7f7e140b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e12ffd700 1 -- 172.21.15.107:0/1040573989 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14160ea0 con 0x7f7e140b3300 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/1040573989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e140b3300 0x7f7e140b3770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e14070140 tx=0x7f7e08009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7f985ac7d95ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e127fc700 1 -- 172.21.15.107:0/1040573989 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011830 con 0x7f7e140b3300 2024-05-08T20:56:53.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e127fc700 1 -- 172.21.15.107:0/1040573989 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08011990 con 0x7f7e140b3300 2024-05-08T20:56:53.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e127fc700 1 -- 172.21.15.107:0/1040573989 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011d20 con 0x7f7e140b3300 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- 172.21.15.107:0/1040573989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e140b3300 msgr2=0x7f7e140b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 --2- 172.21.15.107:0/1040573989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e140b3300 0x7f7e140b3770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e14070140 tx=0x7f7e08009b30 comp rx=0 tx=0).stop 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- 172.21.15.107:0/1040573989 shutdown_connections 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 --2- 172.21.15.107:0/1040573989 >> v2:172.21.15.195:3300/0 conn(0x7f7e14071110 0x7f7e140715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 --2- 172.21.15.107:0/1040573989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e140b3300 0x7f7e140b3770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- 172.21.15.107:0/1040573989 >> 172.21.15.107:0/1040573989 conn(0x7f7e1406a360 msgr2=0x7f7e1406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- 172.21.15.107:0/1040573989 shutdown_connections 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.572+0000 7f7e19f63700 1 -- 172.21.15.107:0/1040573989 wait complete. 2024-05-08T20:56:53.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 Processor -- start 2024-05-08T20:56:53.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 -- start start 2024-05-08T20:56:53.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 0x7f7e14138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e140b3300 0x7f7e1413dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e14146b30 0x7f7e140b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1413e200 con 0x7f7e14071110 2024-05-08T20:56:53.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415de30 con 0x7f7e140b3300 2024-05-08T20:56:53.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e19f63700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14159740 con 0x7f7e14146b30 2024-05-08T20:56:53.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 0x7f7e14138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 0x7f7e14138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50980/0 (socket says 172.21.15.107:50980) 2024-05-08T20:56:53.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 -- 172.21.15.107:0/3634581776 learned_addr learned my addr 172.21.15.107:0/3634581776 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:53.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e13fff700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e14146b30 0x7f7e140b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e140b3300 0x7f7e1413dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 -- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e14146b30 msgr2=0x7f7e140b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e14146b30 0x7f7e140b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 -- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e140b3300 msgr2=0x7f7e1413dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e140b3300 0x7f7e1413dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 -- 172.21.15.107:0/3634581776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e080094b0 con 0x7f7e14071110 2024-05-08T20:56:53.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e140b3300 0x7f7e1413dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:53.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.576+0000 7f7e137fe700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 0x7f7e14138d60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c440 tx=0x7f7e0400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04005d90 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040070d0 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e14159a20 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04007460 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e14159fe0 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140684b0 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e040075c0 con 0x7f7e14071110 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.580+0000 7f7dfbfff700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7e00066730 0x7f7e00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.584+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7e00066730 0x7f7e00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.584+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e04083480 con 0x7f7e14071110 2024-05-08T20:56:53.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.584+0000 7f7e12ffd700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7e00066730 0x7f7e00068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e08008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.588+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7e04050880 con 0x7f7e14071110 2024-05-08T20:56:53.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.796+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e14160870 con 0x7f7e14071110 2024-05-08T20:56:53.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.796+0000 7f7dfbfff700 1 -- 172.21.15.107:0/3634581776 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f7e04053ea0 con 0x7f7e14071110 2024-05-08T20:56:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:53.804 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:56:41.769074+0000","modified":"2024-05-08T20:56:44.783973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7e00066730 msgr2=0x7f7e00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7e00066730 0x7f7e00068bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e08008030 comp rx=0 tx=0).stop 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 msgr2=0x7f7e14138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 0x7f7e14138d60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c440 tx=0x7f7e0400c750 comp rx=0 tx=0).stop 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 shutdown_connections 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7e00066730 0x7f7e00068bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7e14146b30 0x7f7e140b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e140b3300 0x7f7e1413dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 --2- 172.21.15.107:0/3634581776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7e14071110 0x7f7e14138d60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 >> 172.21.15.107:0/3634581776 conn(0x7f7e1406a360 msgr2=0x7f7e140accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:53.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 shutdown_connections 2024-05-08T20:56:53.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.800+0000 7f7e19f63700 1 -- 172.21.15.107:0/3634581776 wait complete. 2024-05-08T20:56:53.808 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-05-08T20:56:53.819 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:56:53.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8359e700 1 Processor -- start 2024-05-08T20:56:53.930 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8359e700 1 -- start start 2024-05-08T20:56:53.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8359e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7ffb840ce990 0x7ffb8415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8359e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8415eda0 con 0x7ffb8415afa0 2024-05-08T20:56:53.931 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8359e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8415ea70 con 0x7ffb8415f770 2024-05-08T20:56:53.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8359e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8415ba90 con 0x7ffb840ce990 2024-05-08T20:56:53.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8259c700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ffb8415afa0 0x7ffb8415b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32824/0 (socket says 172.21.15.107:32824) 2024-05-08T20:56:53.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8259c700 1 -- 172.21.15.107:0/197786244 learned_addr learned my addr 172.21.15.107:0/197786244 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:53.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb79d9b700 1 --2- 172.21.15.107:0/197786244 >> v2:172.21.15.195:3300/0 conn(0x7ffb840ce990 0x7ffb8415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604237959 0 0) 0x7ffb8415eda0 con 0x7ffb8415afa0 2024-05-08T20:56:53.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb700035d0 con 0x7ffb8415afa0 2024-05-08T20:56:53.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386781557 0 0) 0x7ffb700035d0 con 0x7ffb8415afa0 2024-05-08T20:56:53.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 >> v2:172.21.15.195:3300/0 conn(0x7ffb840ce990 msgr2=0x7ffb8415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:53.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 --2- 172.21.15.107:0/197786244 >> v2:172.21.15.195:3300/0 conn(0x7ffb840ce990 0x7ffb8415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 >> v1:172.21.15.195:6789/0 conn(0x7ffb8415f770 legacy=0x7ffb840b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8415bd40 con 0x7ffb8415afa0 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7ffb74001670 con 0x7ffb8415afa0 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 >> v1:172.21.15.107:6789/0 conn(0x7ffb8415afa0 legacy=0x7ffb8415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb70003a70 0x7ffb70003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb70004870 0x7ffb70004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb7000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8415ba90 con 0x7ffb70005280 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7000c1d0 con 0x7ffb70004870 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7000c390 con 0x7ffb70003a70 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb7000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb8259c700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb70003a70 0x7ffb70003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb79d9b700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb70004870 0x7ffb70004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 -- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb70003a70 msgr2=0x7ffb70003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:53.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb70003a70 0x7ffb70003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 -- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb70004870 msgr2=0x7ffb70004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb70004870 0x7ffb70004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 -- 172.21.15.107:0/197786244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700035d0 con 0x7ffb70005280 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 -- 172.21.15.107:0/197786244 reap_dead start 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb82d9d700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb7000ba30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffb840aeba0 tx=0x7ffb700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d68209228f984e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c001db0 con 0x7ffb70005280 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c00cc70 con 0x7ffb70005280 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.924+0000 7ffb81d9b700 1 -- 172.21.15.107:0/197786244 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c003a20 con 0x7ffb70005280 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 -- 172.21.15.107:0/197786244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 msgr2=0x7ffb7000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb7000ba30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffb840aeba0 tx=0x7ffb700058a0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 -- 172.21.15.107:0/197786244 shutdown_connections 2024-05-08T20:56:53.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 --2- 172.21.15.107:0/197786244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb7000ba30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 -- 172.21.15.107:0/197786244 >> 172.21.15.107:0/197786244 conn(0x7ffb8406c330 msgr2=0x7ffb8406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 -- 172.21.15.107:0/197786244 shutdown_connections 2024-05-08T20:56:53.938 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 -- 172.21.15.107:0/197786244 wait complete. 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 Processor -- start 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.928+0000 7ffb8359e700 1 -- start start 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb84142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8414d640 0x7ffb8413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8415cd10 0x7ffb8415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8415d700 con 0x7ffb70005280 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84158970 con 0x7ffb8415cd10 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb84142570 con 0x7ffb8414d640 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb84142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb79d9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8414d640 0x7ffb8413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb82d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8415cd10 0x7ffb8415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb84142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51002/0 (socket says 172.21.15.107:51002) 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 -- 172.21.15.107:0/2292035575 learned_addr learned my addr 172.21.15.107:0/2292035575 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 -- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8414d640 msgr2=0x7ffb8413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8414d640 0x7ffb8413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 -- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8415cd10 msgr2=0x7ffb8415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8415cd10 0x7ffb8415d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 -- 172.21.15.107:0/2292035575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb840cab40 con 0x7ffb70005280 2024-05-08T20:56:53.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb82d9d700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8415cd10 0x7ffb8415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8259c700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb84142030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007290 tx=0x7ffb740075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74012560 con 0x7ffb70005280 2024-05-08T20:56:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740126e0 con 0x7ffb70005280 2024-05-08T20:56:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb840cae20 con 0x7ffb70005280 2024-05-08T20:56:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74012a90 con 0x7ffb70005280 2024-05-08T20:56:53.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb84158600 con 0x7ffb70005280 2024-05-08T20:56:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.932+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb84158460 con 0x7ffb70005280 2024-05-08T20:56:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.936+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb74012bf0 con 0x7ffb70005280 2024-05-08T20:56:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.936+0000 7ffb7b7fe700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb64066760 0x7ffb64068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:53.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.936+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb74083fb0 con 0x7ffb70005280 2024-05-08T20:56:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.936+0000 7ffb79d9b700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb64066760 0x7ffb64068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:53.945 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.936+0000 7ffb79d9b700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb64066760 0x7ffb64068c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb8414dfe0 tx=0x7ffb6c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:53.946 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:53.940+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7ffb740b5cf0 con 0x7ffb70005280 2024-05-08T20:56:54.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.104+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb840684b0 con 0x7ffb70005280 2024-05-08T20:56:54.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.108+0000 7ffb7b7fe700 1 -- 172.21.15.107:0/2292035575 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ffb84158460 con 0x7ffb70005280 2024-05-08T20:56:54.116 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:54.117 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":20,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:56:42.773336+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb64066760 msgr2=0x7ffb64068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb64066760 0x7ffb64068c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb8414dfe0 tx=0x7ffb6c009240 comp rx=0 tx=0).stop 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 msgr2=0x7ffb84142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb84142030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb74007290 tx=0x7ffb740075a0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 shutdown_connections 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb8415cd10 0x7ffb8415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7ffb64066760 0x7ffb64068c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7ffb8414d640 0x7ffb8413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 --2- 172.21.15.107:0/2292035575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb70005280 0x7ffb84142030 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 >> 172.21.15.107:0/2292035575 conn(0x7ffb8406c330 msgr2=0x7ffb840b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:54.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 shutdown_connections 2024-05-08T20:56:54.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.112+0000 7ffb8359e700 1 -- 172.21.15.107:0/2292035575 wait complete. 2024-05-08T20:56:54.132 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:56:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 Processor -- start 2024-05-08T20:56:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 -- start start 2024-05-08T20:56:54.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a0815aed0 0x7f7a080cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a080cb970 0x7f7a080b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080b2e40 0x7f7a0806c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080cd470 con 0x7f7a0815aed0 2024-05-08T20:56:54.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080ced50 con 0x7f7a080cb970 2024-05-08T20:56:54.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0ec1e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080cceb0 con 0x7f7a080b2e40 2024-05-08T20:56:54.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a0815aed0 0x7f7a080cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a07fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7a080cb970 0x7f7a080b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7a0815aed0 0x7f7a080cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51010/0 (socket says 172.21.15.107:51010) 2024-05-08T20:56:54.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/1592816983 learned_addr learned my addr 172.21.15.107:0/1592816983 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:54.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0d1bb700 1 --2- 172.21.15.107:0/1592816983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080b2e40 0x7f7a0806c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/1592816983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080b2e40 msgr2=0x7f7a0806c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:54.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 --2- 172.21.15.107:0/1592816983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080b2e40 0x7f7a0806c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/1592816983 >> v2:172.21.15.195:3300/0 conn(0x7f7a080cb970 msgr2=0x7f7a080b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 --2- 172.21.15.107:0/1592816983 >> v2:172.21.15.195:3300/0 conn(0x7f7a080cb970 0x7f7a080b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/1592816983 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080cd190 con 0x7f7a0815aed0 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a07fff700 1 --2- 172.21.15.107:0/1592816983 >> v2:172.21.15.195:3300/0 conn(0x7f7a080cb970 0x7f7a080b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a0c9ba700 1 --2- 172.21.15.107:0/1592816983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a0815aed0 0x7f7a080cc7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a080ce4d0 tx=0x7f79fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c80146c67b1c39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a077fe700 1 -- 172.21.15.107:0/1592816983 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc011830 con 0x7f7a0815aed0 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a077fe700 1 -- 172.21.15.107:0/1592816983 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc011990 con 0x7f7a0815aed0 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.236+0000 7f7a077fe700 1 -- 172.21.15.107:0/1592816983 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc011d20 con 0x7f7a0815aed0 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/1592816983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a0815aed0 msgr2=0x7f7a080cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/1592816983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a0815aed0 0x7f7a080cc7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a080ce4d0 tx=0x7f79fc009bf0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/1592816983 shutdown_connections 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/1592816983 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080b2e40 0x7f7a0806c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/1592816983 >> v2:172.21.15.195:3300/0 conn(0x7f7a080cb970 0x7f7a080b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/1592816983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a0815aed0 0x7f7a080cc7c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/1592816983 >> 172.21.15.107:0/1592816983 conn(0x7f7a0806a360 msgr2=0x7f7a0806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:54.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/1592816983 shutdown_connections 2024-05-08T20:56:54.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/1592816983 wait complete. 2024-05-08T20:56:54.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 Processor -- start 2024-05-08T20:56:54.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- start start 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 0x7f7a0814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080cb970 0x7f7a08151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a0815aed0 0x7f7a081516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080b0270 con 0x7f7a080b2e40 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080b1060 con 0x7f7a0815aed0 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.240+0000 7f7a0ec1e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080ae4d0 con 0x7f7a080cb970 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 0x7f7a0814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 0x7f7a0814cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51018/0 (socket says 172.21.15.107:51018) 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/2798935556 learned_addr learned my addr 172.21.15.107:0/2798935556 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0d1bb700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a0815aed0 0x7f7a081516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a07fff700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080cb970 0x7f7a08151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080cb970 msgr2=0x7f7a08151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080cb970 0x7f7a08151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a0815aed0 msgr2=0x7f7a081516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a0815aed0 0x7f7a081516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 -- 172.21.15.107:0/2798935556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8009a70 con 0x7f7a080b2e40 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0c9ba700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 0x7f7a0814cf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79fc000c00 tx=0x7f79fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc004510 con 0x7f7a080b2e40 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc01e070 con 0x7f7a080b2e40 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0038c0 con 0x7f7a080b2e40 2024-05-08T20:56:54.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc009570 con 0x7f7a080b2e40 2024-05-08T20:56:54.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a080b0730 con 0x7f7a080b2e40 2024-05-08T20:56:54.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.244+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a080684b0 con 0x7f7a080b2e40 2024-05-08T20:56:54.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.248+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79fc003a20 con 0x7f7a080b2e40 2024-05-08T20:56:54.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.248+0000 7f7a057fa700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f79f4066730 0x7f79f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:54.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.248+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79fc020070 con 0x7f7a080b2e40 2024-05-08T20:56:54.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.248+0000 7f7a07fff700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f79f4066730 0x7f79f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:54.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.248+0000 7f7a07fff700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f79f4066730 0x7f79f4068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a08151d20 tx=0x7f79f800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:54.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.252+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f79fc0528c0 con 0x7f7a080b2e40 2024-05-08T20:56:54.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.464+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a08070dd0 con 0x7f7a080b2e40 2024-05-08T20:56:54.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.464+0000 7f7a057fa700 1 -- 172.21.15.107:0/2798935556 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f79fc055ee0 con 0x7f7a080b2e40 2024-05-08T20:56:54.472 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:56:54.472 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:56:41.769074+0000","modified":"2024-05-08T20:56:44.783973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f79f4066730 msgr2=0x7f79f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f79f4066730 0x7f79f4068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a08151d20 tx=0x7f79f800b040 comp rx=0 tx=0).stop 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 msgr2=0x7f7a0814cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 0x7f7a0814cf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79fc000c00 tx=0x7f79fc004770 comp rx=0 tx=0).stop 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 shutdown_connections 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a0815aed0 0x7f7a081516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f79f4066730 0x7f79f4068bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7a080cb970 0x7f7a08151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 --2- 172.21.15.107:0/2798935556 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a080b2e40 0x7f7a0814cf30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 >> 172.21.15.107:0/2798935556 conn(0x7f7a0806a360 msgr2=0x7f7a080701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 shutdown_connections 2024-05-08T20:56:54.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:54.468+0000 7f7a0ec1e700 1 -- 172.21.15.107:0/2798935556 wait complete. 2024-05-08T20:56:54.476 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-05-08T20:56:54.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T20:56:41.769074+0000', 'modified': '2024-05-08T20:56:44.783973+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.195:6833/3391825242', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 3391825242}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 3391825242}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T20:56:54.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T20:56:54.890 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T20:56:55.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 Processor -- start 2024-05-08T20:56:55.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 -- start start 2024-05-08T20:56:55.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd2041624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd204070110 0x7fd2040705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd204158960 con 0x7fd204071e70 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2040b1f60 con 0x7fd204070110 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040ae990 con 0x7fd2040b3c20 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd204070110 0x7fd2040705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd2037fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd2041624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd202ffd700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd204071e70 0x7fd2040b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:50234/0 (socket says 172.21.15.107:50234) 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 --2- 172.21.15.107:0/2207800234 >> v2:172.21.15.195:3300/0 conn(0x7fd204070110 0x7fd2040705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:39056/0 (socket says 172.21.15.107:39056) 2024-05-08T20:56:55.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd202ffd700 1 -- 172.21.15.107:0/2207800234 learned_addr learned my addr 172.21.15.107:0/2207800234 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 -- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 msgr2=0x7fd2041624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 --2- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd2041624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 -- 172.21.15.107:0/2207800234 >> v1:172.21.15.195:6789/0 conn(0x7fd204071e70 legacy=0x7fd2040b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 -- 172.21.15.107:0/2207800234 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040b2170 con 0x7fd204070110 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd2041624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd203fff700 1 --2- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd2040705a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009d90 tx=0x7fd1fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e3de346093136f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd2027fc700 1 -- 172.21.15.107:0/2207800234 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00e070 con 0x7fd204070110 2024-05-08T20:56:55.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd2027fc700 1 -- 172.21.15.107:0/2207800234 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00bb20 con 0x7fd204070110 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd2027fc700 1 -- 172.21.15.107:0/2207800234 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc012430 con 0x7fd204070110 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 -- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 msgr2=0x7fd2040705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.008+0000 7fd208afa700 1 --2- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd2040705a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009d90 tx=0x7fd1fc00b330 comp rx=0 tx=0).stop 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- 172.21.15.107:0/2207800234 shutdown_connections 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 --2- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd2040705a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 --2- 172.21.15.107:0/2207800234 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd2041624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- 172.21.15.107:0/2207800234 >> 172.21.15.107:0/2207800234 conn(0x7fd20406c330 msgr2=0x7fd20406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- 172.21.15.107:0/2207800234 shutdown_connections 2024-05-08T20:56:55.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- 172.21.15.107:0/2207800234 wait complete. 2024-05-08T20:56:55.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 Processor -- start 2024-05-08T20:56:55.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- start start 2024-05-08T20:56:55.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd20413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 0x7fd204164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd204164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20406cf70 con 0x7fd204071e70 2024-05-08T20:56:55.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204140020 con 0x7fd204070110 2024-05-08T20:56:55.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd208afa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041650e0 con 0x7fd2040b3c20 2024-05-08T20:56:55.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 0x7fd204164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 0x7fd204164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51032/0 (socket says 172.21.15.107:51032) 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 -- 172.21.15.107:0/1856719737 learned_addr learned my addr 172.21.15.107:0/1856719737 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd203fff700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd204164a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd2037fe700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd20413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 -- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 msgr2=0x7fd204164a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd204164a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 -- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 msgr2=0x7fd20413fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd20413fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 -- 172.21.15.107:0/1856719737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0094b0 con 0x7fd204071e70 2024-05-08T20:56:55.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.012+0000 7fd202ffd700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 0x7fd204164540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4001eb0 tx=0x7fd1f400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd1fbfff700 1 -- 172.21.15.107:0/1856719737 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4005d90 con 0x7fd204071e70 2024-05-08T20:56:55.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd1fbfff700 1 -- 172.21.15.107:0/1856719737 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f40070d0 con 0x7fd204071e70 2024-05-08T20:56:55.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd1fbfff700 1 -- 172.21.15.107:0/1856719737 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4007440 con 0x7fd204071e70 2024-05-08T20:56:55.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc009a70 con 0x7fd204071e70 2024-05-08T20:56:55.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204158af0 con 0x7fd204071e70 2024-05-08T20:56:55.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd1fbfff700 1 -- 172.21.15.107:0/1856719737 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1f40075a0 con 0x7fd204071e70 2024-05-08T20:56:55.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd1fbfff700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd1e4066730 0x7fd1e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd2037fe700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd1e4066730 0x7fd1e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.016+0000 7fd1fbfff700 1 -- 172.21.15.107:0/1856719737 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1f4083370 con 0x7fd204071e70 2024-05-08T20:56:55.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.020+0000 7fd2037fe700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd1e4066730 0x7fd1e4068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009d80 tx=0x7fd1ec009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.020+0000 7fd20d00b740 1 Processor -- start 2024-05-08T20:56:55.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.020+0000 7fd20d00b740 1 -- start start 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.020+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2761ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2729470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x27299b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x2688d80 con 0x2758be0 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x2686510 con 0x2762420 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x2681e00 con 0x2761b00 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2729470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2729470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51048/0 (socket says 172.21.15.107:51048) 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 -- 172.21.15.107:0/3777959281 learned_addr learned my addr 172.21.15.107:0/3777959281 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:55.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd2037fe700 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2761ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd203fff700 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x27299b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 -- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 msgr2=0x2761ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2761ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 -- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 msgr2=0x27299b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x27299b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 -- 172.21.15.107:0/3777959281 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24f4960 con 0x2758be0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd2037fe700 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2761ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd202ffd700 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2729470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1f405c250 tx=0x7fd1f4054290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc44e65eadd002c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd1f97fa700 1 -- 172.21.15.107:0/3777959281 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4054440 con 0x2758be0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd1f97fa700 1 -- 172.21.15.107:0/3777959281 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f40581c0 con 0x2758be0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd1f97fa700 1 -- 172.21.15.107:0/3777959281 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f405c780 con 0x2758be0 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- 172.21.15.107:0/3777959281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 msgr2=0x2729470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2729470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1f405c250 tx=0x7fd1f4054290 comp rx=0 tx=0).stop 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- 172.21.15.107:0/3777959281 shutdown_connections 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x27299b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2729470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 --2- 172.21.15.107:0/3777959281 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2761ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- 172.21.15.107:0/3777959281 >> 172.21.15.107:0/3777959281 conn(0x24a94d0 msgr2=0x2743250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- 172.21.15.107:0/3777959281 shutdown_connections 2024-05-08T20:56:55.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- 172.21.15.107:0/3777959281 wait complete. 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 -- start start 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.024+0000 7fd20d00b740 1 Processor -- start 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x2767ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x276aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x272c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x263f730 con 0x2761b00 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x26455b0 con 0x2758be0 2024-05-08T20:56:55.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x252daa0 con 0x2762420 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 10 client.0 _ll_register_callbacks cb 0x267b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x276aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x276aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51056/0 (socket says 172.21.15.107:51056) 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 -- 172.21.15.107:0/2584857033 learned_addr learned my addr 172.21.15.107:0/2584857033 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x2767ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd203fff700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x272c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 -- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 msgr2=0x272c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x272c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 -- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 msgr2=0x2767ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x2767ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 -- 172.21.15.107:0/2584857033 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204158af0 con 0x2761b00 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd203fff700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x272c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd202ffd700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x276aa70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4007fd0 tx=0x7fd1f400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d43df57911f029 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 1 -- 172.21.15.107:0/2584857033 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40548b0 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 1 -- 172.21.15.107:0/2584857033 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1f4053930 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24b61e0 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 1 -- 172.21.15.107:0/2584857033 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f4053b10 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 10 client.4671 fetch_fsmap learned FSMap version 8 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x2648220 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 1 -- 172.21.15.107:0/2584857033 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24b61e0 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 1 -- 172.21.15.107:0/2584857033 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd1f4081330 con 0x2761b00 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 10 client.4671 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 20 client.4671 populate_metadata read hostname 'smithi107' 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x275a140 0x275a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 4 client.4671 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:56:55.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 --> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2500460 con 0x275a140 2024-05-08T20:56:55.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x275a140 0x275a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd1e27fc700 10 client.4671 ms_handle_connect on v2:172.21.15.195:6832/3391825242 2024-05-08T20:56:55.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.028+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x275a140 0x275a520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c79dece583ed486 server_cookie=b83c7195af9b6188 in_seq=0 out_seq=0 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd1e27fc700 1 -- 172.21.15.107:0/2584857033 <== mds.0 v2:172.21.15.195:6832/3391825242 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x2500460 con 0x275a140 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd1e27fc700 10 client.4671 handle_command_reply: tid=0 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 client.4671 shutdown 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 msgr2=0x276aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x276aa70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4007fd0 tx=0x7fd1f400cd30 comp rx=0 tx=0).stop 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 shutdown_connections 2024-05-08T20:56:55.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x275a140 0x275a520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x272c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x276aa70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd1e27fc700 0 client.4671 ms_handle_reset on v2:172.21.15.195:6832/3391825242 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2584857033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x2767ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 >> 172.21.15.107:0/2584857033 conn(0x24a94d0 msgr2=0x2742a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 shutdown_connections 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 1 -- 172.21.15.107:0/2584857033 wait complete. 2024-05-08T20:56:55.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.032+0000 7fd20d00b740 20 client.4671 trim_cache size 0 max 16384 2024-05-08T20:56:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 Processor -- start 2024-05-08T20:56:55.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- start start 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2719740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2719c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x271a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x264c4f0 con 0x2758be0 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x26455b0 con 0x2762420 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x275a740 con 0x2761b00 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2719740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2719740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51062/0 (socket says 172.21.15.107:51062) 2024-05-08T20:56:55.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 -- 172.21.15.107:0/2059061825 learned_addr learned my addr 172.21.15.107:0/2059061825 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd203fff700 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x271a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd202ffd700 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2719c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 -- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 msgr2=0x2719c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2719c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 -- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 msgr2=0x271a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x271a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 -- 172.21.15.107:0/2059061825 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x262e450 con 0x2758be0 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd203fff700 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x271a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd2037fe700 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2719740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009b60 tx=0x7fd1ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76bf5d04401891b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd1f9ffb700 1 -- 172.21.15.107:0/2059061825 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004450 con 0x2758be0 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd1f9ffb700 1 -- 172.21.15.107:0/2059061825 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec0045b0 con 0x2758be0 2024-05-08T20:56:55.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd1f9ffb700 1 -- 172.21.15.107:0/2059061825 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec029400 con 0x2758be0 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- 172.21.15.107:0/2059061825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 msgr2=0x2719740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2719740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009b60 tx=0x7fd1ec018000 comp rx=0 tx=0).stop 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- 172.21.15.107:0/2059061825 shutdown_connections 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2762420 0x271a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2761b00 0x2719c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 --2- 172.21.15.107:0/2059061825 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2758be0 0x2719740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- 172.21.15.107:0/2059061825 >> 172.21.15.107:0/2059061825 conn(0x24a94d0 msgr2=0x2766820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- 172.21.15.107:0/2059061825 shutdown_connections 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- 172.21.15.107:0/2059061825 wait complete. 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 -- start start 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.056+0000 7fd20d00b740 1 Processor -- start 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x27c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x27c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x27c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x26b0ec0 con 0x2761b00 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x27619b0 con 0x2758be0 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x2761780 con 0x2762420 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 10 client.0 _ll_register_callbacks cb 0x7fd1f4000f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x27c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x27c2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51078/0 (socket says 172.21.15.107:51078) 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 -- 172.21.15.107:0/402454497 learned_addr learned my addr 172.21.15.107:0/402454497 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd2037fe700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x27c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd203fff700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x27c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 -- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 msgr2=0x27c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x27c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 -- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 msgr2=0x27c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x27c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 -- 172.21.15.107:0/402454497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2040b2170 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd1e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd202ffd700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x27c2220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4050940 tx=0x7fd1f4007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68900fba71b2aee9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd1e27fc700 1 -- 172.21.15.107:0/402454497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4050780 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd1e27fc700 1 -- 172.21.15.107:0/402454497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1f4081330 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25251e0 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd1e27fc700 1 -- 172.21.15.107:0/402454497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1f4040ea0 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 10 client.4677 fetch_fsmap learned FSMap version 8 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fd1ec0099d0 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd1e27fc700 1 -- 172.21.15.107:0/402454497 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25251e0 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd1e27fc700 1 -- 172.21.15.107:0/402454497 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd1f407b400 con 0x2761b00 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2024-05-08T20:56:55.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 10 client.4677 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 20 client.4677 populate_metadata read hostname 'smithi107' 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x27c3080 0x2716750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 4 client.4677 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 --> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] -- command(tid 0: {"prefix": "status"}) v1 -- 0x271a330 con 0x27c3080 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.060+0000 7fd2037fe700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x27c3080 0x2716750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd1e27fc700 10 client.4677 ms_handle_connect on v2:172.21.15.195:6832/3391825242 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd2037fe700 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x27c3080 0x2716750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d37355d927d411 server_cookie=47db77f013d1cbae in_seq=0 out_seq=0 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd1e27fc700 1 -- 172.21.15.107:0/402454497 <== mds.0 v2:172.21.15.195:6832/3391825242 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x271a330 con 0x27c3080 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd1e27fc700 10 client.4677 handle_command_reply: tid=0 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 client.4677 shutdown 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 msgr2=0x27c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x27c2220 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4050940 tx=0x7fd1f4007850 comp rx=0 tx=0).stop 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 shutdown_connections 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:6832/3391825242,v1:172.21.15.195:6833/3391825242] conn(0x27c3080 0x2716750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x2762420 0x27c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd1e27fc700 0 client.4677 ms_handle_reset on v2:172.21.15.195:6832/3391825242 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x2761b00 0x27c2220 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 --2- 172.21.15.107:0/402454497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x2758be0 0x27c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 >> 172.21.15.107:0/402454497 conn(0x24a94d0 msgr2=0x27609b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 shutdown_connections 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 1 -- 172.21.15.107:0/402454497 wait complete. 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd20d00b740 20 client.4677 trim_cache size 0 max 16384 2024-05-08T20:56:55.079 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "1fb7fa61-19f6-46b1-9f16-722373da360d", 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4305, 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 13.295194766, 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 8, 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 20, 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 20, 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 19.708220558000001 2024-05-08T20:56:55.080 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd1e4066730 msgr2=0x7fd1e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd1e4066730 0x7fd1e4068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009d80 tx=0x7fd1ec009240 comp rx=0 tx=0).stop 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 msgr2=0x7fd204164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 0x7fd204164540 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4001eb0 tx=0x7fd1f400c7b0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 shutdown_connections 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd1e4066730 0x7fd1e4068bf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd2040b3c20 0x7fd204164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd204071e70 0x7fd204164540 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 --2- 172.21.15.107:0/1856719737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd204070110 0x7fd20413fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 >> 172.21.15.107:0/1856719737 conn(0x7fd20406c330 msgr2=0x7fd2040aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 shutdown_connections 2024-05-08T20:56:55.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.064+0000 7fd208afa700 1 -- 172.21.15.107:0/1856719737 wait complete. 2024-05-08T20:56:55.090 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T20:56:55.100 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T20:56:55.100 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T20:56:55.100 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T20:56:55.100 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-08T20:56:55.140 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-08T20:56:55.140 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-08T20:56:55.140 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-08T20:56:55.140 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:56:55.140 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:56:55.140 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-08T20:56:55.140 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:56:55.141 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T20:56:55.141 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-08T20:56:55.141 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:56:55.141 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T20:56:55.141 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-08T20:56:55.141 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:56:55.141 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T20:56:55.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.141 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-08T20:56:55.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.150 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-08T20:56:55.170 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-05-08T20:56:55.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:56:55.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.171 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-05-08T20:56:55.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.179 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-05-08T20:56:55.199 INFO:teuthology.orchestra.run.smithi195.stderr:Cannot find device "ceph-brx" 2024-05-08T20:56:55.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:56:55.200 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-08T20:56:55.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:56:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.316+0000 7f72c96f1700 1 Processor -- start 2024-05-08T20:56:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.316+0000 7f72c96f1700 1 -- start start 2024-05-08T20:56:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f72c4071ab0 0x7f72c40ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40cea50 con 0x7f72c4071e90 2024-05-08T20:56:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40ce080 con 0x7f72c4071ab0 2024-05-08T20:56:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40cd7c0 con 0x7f72c415ac70 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c3fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f72c4071ab0 0x7f72c40ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c37fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f72c4071e90 0x7f72c415a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:32836/0 (socket says 172.21.15.107:32836) 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c37fe700 1 -- 172.21.15.107:0/2984604893 learned_addr learned my addr 172.21.15.107:0/2984604893 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c8ef0700 1 --2- 172.21.15.107:0/2984604893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c3fff700 1 -- 172.21.15.107:0/2984604893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 msgr2=0x7f72c413d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c3fff700 1 --2- 172.21.15.107:0/2984604893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c3fff700 1 -- 172.21.15.107:0/2984604893 >> v1:172.21.15.107:6789/0 conn(0x7f72c4071e90 legacy=0x7f72c415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c3fff700 1 -- 172.21.15.107:0/2984604893 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40cda30 con 0x7f72c4071ab0 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c2ffd700 1 -- 172.21.15.107:0/2984604893 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672361049 0 0) 0x7f72ac001110 con 0x7f72c4071e90 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c3fff700 1 --2- 172.21.15.107:0/2984604893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071ab0 0x7f72c40ce510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79b28c258b7c730 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c2ffd700 1 -- 172.21.15.107:0/2984604893 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400e070 con 0x7f72c4071ab0 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c2ffd700 1 -- 172.21.15.107:0/2984604893 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400bbd0 con 0x7f72c4071ab0 2024-05-08T20:56:55.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c2ffd700 1 -- 172.21.15.107:0/2984604893 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4012430 con 0x7f72c4071ab0 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- 172.21.15.107:0/2984604893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071ab0 msgr2=0x7f72c40ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 --2- 172.21.15.107:0/2984604893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071ab0 0x7f72c40ce510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009d90 tx=0x7f72b400b330 comp rx=0 tx=0).stop 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- 172.21.15.107:0/2984604893 shutdown_connections 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 --2- 172.21.15.107:0/2984604893 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 --2- 172.21.15.107:0/2984604893 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071ab0 0x7f72c40ce510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- 172.21.15.107:0/2984604893 >> 172.21.15.107:0/2984604893 conn(0x7f72c406c330 msgr2=0x7f72c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- 172.21.15.107:0/2984604893 shutdown_connections 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.320+0000 7f72c96f1700 1 -- 172.21.15.107:0/2984604893 wait complete. 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 Processor -- start 2024-05-08T20:56:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 -- start start 2024-05-08T20:56:55.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c4071ab0 0x7f72c4158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 0x7f72c4153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4158650 con 0x7f72c4071e90 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c41579d0 con 0x7f72c4071ab0 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c96f1700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4157cb0 con 0x7f72c415ac70 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 0x7f72c4153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 0x7f72c4153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51100/0 (socket says 172.21.15.107:51100) 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 -- 172.21.15.107:0/572316721 learned_addr learned my addr 172.21.15.107:0/572316721 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c3fff700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c4071ab0 0x7f72c4158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c8ef0700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 -- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 msgr2=0x7f72c413eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 -- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c4071ab0 msgr2=0x7f72c4158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c4071ab0 0x7f72c4158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 -- 172.21.15.107:0/572316721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b4009a70 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c3fff700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c4071ab0 0x7f72c4158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.324+0000 7f72c37fe700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 0x7f72c4153560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c750 tx=0x7f72ac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac004ca0 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac004e20 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c4157f90 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac007310 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c4153aa0 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72ac007470 con 0x7f72c4071e90 2024-05-08T20:56:55.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c4158790 con 0x7f72c4071e90 2024-05-08T20:56:55.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c0ff9700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:55.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72ac0831e0 con 0x7f72c4071e90 2024-05-08T20:56:55.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c3fff700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:55.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.328+0000 7f72c3fff700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f72b4014040 tx=0x7f72b4011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:55.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.336+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f72c4158790 con 0x7f72c4071e90 2024-05-08T20:56:55.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72c40cea50 con 0x7f72c4071e90 2024-05-08T20:56:55.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c0ff9700 1 -- 172.21.15.107:0/572316721 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72c40cea50 con 0x7f72c4071e90 2024-05-08T20:56:55.555 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T20:56:55.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 msgr2=0x7f72a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f72b4014040 tx=0x7f72b4011000 comp rx=0 tx=0).stop 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 msgr2=0x7f72c4153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 0x7f72c4153560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00c750 tx=0x7f72ac00cb10 comp rx=0 tx=0).stop 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 shutdown_connections 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f72a4066730 0x7f72a4068bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72c415ac70 0x7f72c413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72c4071e90 0x7f72c4153560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 --2- 172.21.15.107:0/572316721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c4071ab0 0x7f72c4158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 >> 172.21.15.107:0/572316721 conn(0x7f72c406c330 msgr2=0x7f72c413fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 shutdown_connections 2024-05-08T20:56:55.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:55.548+0000 7f72c96f1700 1 -- 172.21.15.107:0/572316721 wait complete. 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:56:55.570 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:56:55.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.571 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-05-08T20:56:55.579 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:56:55.579 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:56:55.579 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:56:55.579 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:55.579 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:55.580 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42526sec preferred_lft 42526sec 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 02:42:60:7a:a0:5e brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:55.581 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-08T20:56:55.582 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:55.582 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:56:55.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.582 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:55.583 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:55.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:56:55.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-05-08T20:56:55.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-05-08T20:56:55.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:56:55.583 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:55.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.625 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:56:55.684 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-08T20:56:55.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.686 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-05-08T20:56:55.708 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-05-08T20:56:55.708 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:56:55.708 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-08T20:56:55.708 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:56:55.708 INFO:teuthology.orchestra.run.smithi107.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-08T20:56:55.709 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-05-08T20:56:55.709 INFO:teuthology.orchestra.run.smithi107.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:56:55.709 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:56:55.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.709 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:55.709 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:55.709 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:56:55.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:56:55.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:56:55.710 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:55.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.754 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-08T20:56:55.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.805 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-05-08T20:56:55.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.812 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:55.812 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:55.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:56:55.812 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T20:56:55.812 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:55.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T20:56:55.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.887 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:55.887 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:55.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T20:56:55.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:56:55.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T20:56:55.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T20:56:55.888 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T20:56:55.888 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:55.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:55.956 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:55.956 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:55.957 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-05-08T20:56:55.957 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:56:55.957 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:55.985 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-08T20:56:55.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:56:55.985 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T20:56:55.991 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:56:55.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:56:55.992 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:56:56.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-08T20:56:56.055 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:56:56.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:56:56.066 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:56:56.067 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:56:56.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:56.068 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-08T20:56:56.073 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T20:56:56.073 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-08T20:56:56.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-08T20:56:56.136 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:56:56.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:56:56.145 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:56:56.146 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:56:56.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:56.146 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-08T20:56:56.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:2024-05-08T20:56:56.200+0000 7f5e6134d640 -1 init, newargv = 0x55e0ced269e0 newargc=15 2024-05-08T20:56:56.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[33670]: starting ceph client 2024-05-08T20:56:56.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[33670]: starting fuse 2024-05-08T20:56:57.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-08T20:56:57.271 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:56:57.271 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:56:57.329 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:56:57.330 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:56:57.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:57.330 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-08T20:56:57.337 INFO:teuthology.orchestra.run.smithi107.stdout:52 2024-05-08T20:56:57.338 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-05-08T20:56:57.338 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:56:57.338 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2024-05-08T20:56:57.338 DEBUG:teuthology.orchestra.run.smithi107:> import re 2024-05-08T20:56:57.338 DEBUG:teuthology.orchestra.run.smithi107:> import os 2024-05-08T20:56:57.338 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2024-05-08T20:56:57.339 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> return f 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.0")) 2024-05-08T20:56:57.340 DEBUG:teuthology.orchestra.run.smithi107:> ' 2024-05-08T20:56:57.423 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.0.33670.asok 2024-05-08T20:56:57.607 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33670.asok 2024-05-08T20:56:57.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:57.607 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33670.asok status 2024-05-08T20:56:57.752 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "0", 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "33670", 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2024-05-08T20:56:57.753 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4695, 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4695 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1326691301 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-08T20:56:57.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1326691301 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4695 192.168.0.1:0/1326691301", 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.1:0/1326691301", 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 8, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 20, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2024-05-08T20:56:57.755 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2024-05-08T20:56:57.756 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T20:56:57.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:56:57.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 Processor -- start 2024-05-08T20:56:57.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- start start 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f45180ce990 0x7f451815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f451815f770 0x7f45180b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451815eda0 con 0x7f451815afa0 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451815ea70 con 0x7f451815f770 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451815ba90 con 0x7f45180ce990 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f451815f770 0x7f45180b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f451815f770 0x7f45180b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51852/0 (socket says 172.21.15.107:51852) 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 -- 172.21.15.107:0/999843918 learned_addr learned my addr 172.21.15.107:0/999843918 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:57.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451cb2c700 1 --2- 172.21.15.107:0/999843918 >> v2:172.21.15.195:3300/0 conn(0x7f45180ce990 0x7f451815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 -- 172.21.15.107:0/999843918 >> v2:172.21.15.195:3300/0 conn(0x7f45180ce990 msgr2=0x7f451815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 --2- 172.21.15.107:0/999843918 >> v2:172.21.15.195:3300/0 conn(0x7f45180ce990 0x7f451815f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 -- 172.21.15.107:0/999843918 >> v1:172.21.15.195:6789/0 conn(0x7f451815afa0 legacy=0x7f451815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 -- 172.21.15.107:0/999843918 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451815bd40 con 0x7f451815f770 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451db2e700 1 --2- 172.21.15.107:0/999843918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f45180b4270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f451806df50 tx=0x7f451000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5153afee55394076 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f450ffff700 1 -- 172.21.15.107:0/999843918 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000e070 con 0x7f451815f770 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f450ffff700 1 -- 172.21.15.107:0/999843918 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451000b9c0 con 0x7f451815f770 2024-05-08T20:56:57.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f450ffff700 1 -- 172.21.15.107:0/999843918 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451000bd70 con 0x7f451815f770 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- 172.21.15.107:0/999843918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 msgr2=0x7f45180b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 --2- 172.21.15.107:0/999843918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f45180b4270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f451806df50 tx=0x7f451000b330 comp rx=0 tx=0).stop 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- 172.21.15.107:0/999843918 shutdown_connections 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 --2- 172.21.15.107:0/999843918 >> v2:172.21.15.195:3300/0 conn(0x7f45180ce990 0x7f451815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 --2- 172.21.15.107:0/999843918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f45180b4270 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- 172.21.15.107:0/999843918 >> 172.21.15.107:0/999843918 conn(0x7f451806c330 msgr2=0x7f451806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:57.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- 172.21.15.107:0/999843918 shutdown_connections 2024-05-08T20:56:57.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.872+0000 7f451e32f700 1 -- 172.21.15.107:0/999843918 wait complete. 2024-05-08T20:56:57.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 Processor -- start 2024-05-08T20:56:57.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 -- start start 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45180ce990 0x7f45181481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451815afa0 0x7f4518154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f4518154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45181486f0 con 0x7f451815f770 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4518159800 con 0x7f451815afa0 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451e32f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4518158bf0 con 0x7f45180ce990 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f4518154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f4518154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51862/0 (socket says 172.21.15.107:51862) 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 -- 172.21.15.107:0/2109398455 learned_addr learned my addr 172.21.15.107:0/2109398455 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:56:57.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451d32d700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45180ce990 0x7f45181481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451cb2c700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451815afa0 0x7f4518154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 -- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45180ce990 msgr2=0x7f45181481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45180ce990 0x7f45181481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 -- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451815afa0 msgr2=0x7f4518154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451815afa0 0x7f4518154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 -- 172.21.15.107:0/2109398455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510009b30 con 0x7f451815f770 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.876+0000 7f451db2e700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f4518154cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4510012000 tx=0x7f4510004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510004880 con 0x7f451815f770 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45100099b0 con 0x7f451815f770 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4518158ed0 con 0x7f451815f770 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451001b670 con 0x7f451815f770 2024-05-08T20:56:57.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4518159490 con 0x7f451815f770 2024-05-08T20:56:57.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45180684b0 con 0x7f451815f770 2024-05-08T20:56:57.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f451001b7d0 con 0x7f451815f770 2024-05-08T20:56:57.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f450dffb700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f44fc066730 0x7f44fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:56:57.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4510085580 con 0x7f451815f770 2024-05-08T20:56:57.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f451d32d700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f44fc066730 0x7f44fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:56:57.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.880+0000 7f451d32d700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f44fc066730 0x7f44fc068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4514000f60 tx=0x7f4514009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:56:57.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:57.892+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4510052980 con 0x7f451815f770 2024-05-08T20:56:58.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4518159620 con 0x7f451815f770 2024-05-08T20:56:58.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f450dffb700 1 -- 172.21.15.107:0/2109398455 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4518159620 con 0x7f451815f770 2024-05-08T20:56:58.107 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T20:56:58.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f44fc066730 msgr2=0x7f44fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:58.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f44fc066730 0x7f44fc068bf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4514000f60 tx=0x7f4514009040 comp rx=0 tx=0).stop 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 msgr2=0x7f4518154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f4518154cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4510012000 tx=0x7f4510004af0 comp rx=0 tx=0).stop 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 shutdown_connections 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f451815f770 0x7f4518154cb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f451815afa0 0x7f4518154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f44fc066730 0x7f44fc068bf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 --2- 172.21.15.107:0/2109398455 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f45180ce990 0x7f45181481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 >> 172.21.15.107:0/2109398455 conn(0x7f451806c330 msgr2=0x7f45180cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 shutdown_connections 2024-05-08T20:56:58.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:56:58.100+0000 7f451e32f700 1 -- 172.21.15.107:0/2109398455 wait complete. 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T20:56:58.121 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:56:58.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:56:58.122 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-08T20:56:58.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.122 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:58.130 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42523sec preferred_lft 42523sec 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 02:42:60:7a:a0:5e brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-08T20:56:58.131 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 9e:df:db:13:64:06 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::8852:edff:fe9e:cdf0/64 scope link 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 9e:df:db:13:64:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::9cdf:dbff:fe13:6406/64 scope link 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.133 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:56:58.144 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-08T20:56:58.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.146 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-05-08T20:56:58.197 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:56:58.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.199 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:58.199 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:58.199 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:56:58.199 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:56:58.199 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:56:58.199 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:58.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.237 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-08T20:56:58.284 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T20:56:58.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.285 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-05-08T20:56:58.290 INFO:teuthology.orchestra.run.smithi107.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-08T20:56:58.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.291 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:58.291 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:58.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T20:56:58.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-08T20:56:58.291 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:58.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T20:56:58.382 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:56:58.382 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether fe:3a:1e:df:3f:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::fc3a:1eff:fedf:3f75/64 scope link 2024-05-08T20:56:58.383 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-08T20:56:58.397 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:56:58.397 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether fe:3a:1e:df:3f:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::fc3a:1eff:fedf:3f75/64 scope link 2024-05-08T20:56:58.398 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:56:58.399 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-08T20:56:58.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-08T20:56:58.400 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:58.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.454 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec bash -c ' 2024-05-08T20:56:58.454 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-08T20:56:58.454 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.1 up 2024-05-08T20:56:58.454 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T20:56:58.454 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-08T20:56:58.478 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-08T20:56:58.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:56:58.478 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-08T20:56:58.528 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-08T20:56:58.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:56:58.529 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-08T20:56:58.536 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-08T20:56:58.548 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:56:58.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:56:58.558 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:56:58.559 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:56:58.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.560 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-08T20:56:58.608 INFO:teuthology.orchestra.run.smithi107.stdout:52 2024-05-08T20:56:58.608 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-05-08T20:56:58.608 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-08T20:56:58.610 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-08T20:56:58.627 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:56:58.627 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:56:58.642 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:56:58.643 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:56:58.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:58.644 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-08T20:56:58.692 INFO:teuthology.orchestra.run.smithi107.stdout:52 2024-05-08T20:56:58.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi107.stderr:2024-05-08T20:56:58.688+0000 7f284b1b4640 -1 init, newargv = 0x563de5992cb0 newargc=15 2024-05-08T20:56:58.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi107.stderr:ceph-fuse[33810]: starting ceph client 2024-05-08T20:56:58.702 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi107.stderr:ceph-fuse[33810]: starting fuse 2024-05-08T20:56:59.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo modprobe fuse 2024-05-08T20:56:59.814 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:56:59.814 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:56:59.830 INFO:teuthology.orchestra.run.smithi107.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:56:59.832 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:56:59.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:56:59.832 DEBUG:teuthology.orchestra.run.smithi107:> ls /sys/fs/fuse/connections 2024-05-08T20:56:59.838 INFO:teuthology.orchestra.run.smithi107.stdout:52 2024-05-08T20:56:59.838 INFO:teuthology.orchestra.run.smithi107.stdout:53 2024-05-08T20:56:59.838 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-05-08T20:56:59.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:56:59.838 DEBUG:teuthology.orchestra.run.smithi107:> import glob 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> import re 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> import os 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> import subprocess 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> def _find_admin_socket(client_name): 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> files = glob.glob(asok_path) 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> # Given a non-glob path, it better be there 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> if "*" not in asok_path: 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> assert(len(files) == 1) 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> return files[0] 2024-05-08T20:56:59.839 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> for f in files: 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> contents = proc_f.read() 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> if mountpoint in contents: 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> return f 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> print(_find_admin_socket("client.2")) 2024-05-08T20:56:59.840 DEBUG:teuthology.orchestra.run.smithi107:> ' 2024-05-08T20:56:59.924 INFO:teuthology.orchestra.run.smithi107.stdout:/var/run/ceph/ceph-client.2.33810.asok 2024-05-08T20:57:00.106 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.33810.asok 2024-05-08T20:57:00.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.106 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.33810.asok status 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "metadata": { 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "entity_id": "2", 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": "smithi107", 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "pid": "33810", 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "root": "/" 2024-05-08T20:57:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_count": 0, 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "dentry_pinned_count": 0, 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 4704, 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "inst": { 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "name": { 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "client", 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "num": 4704 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.2:0", 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2492446554 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-08T20:57:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": { 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "192.168.0.2:0", 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2492446554 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "inst_str": "client.4704 192.168.0.2:0/2492446554", 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "addr_str": "192.168.0.2:0/2492446554", 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "inode_count": 1, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_epoch": 8, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch": 20, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "blocklisted": false, 2024-05-08T20:57:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs" 2024-05-08T20:57:00.251 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T20:57:00.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:57:00.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.360+0000 7f8ffd9cd700 1 Processor -- start 2024-05-08T20:57:00.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.360+0000 7f8ffd9cd700 1 -- start start 2024-05-08T20:57:00.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8ff80cf980 0x7f8ff815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:00.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80d0bd0 0x7f8ff80d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff815e830 con 0x7f8ff80cddf0 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff80ce2d0 con 0x7f8ff80cf980 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80ce5b0 con 0x7f8ff80d0bd0 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff7fff700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8ff80cddf0 0x7f8ff80cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:38470/0 (socket says 172.21.15.107:38470) 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff7fff700 1 -- 172.21.15.107:0/2921652995 learned_addr learned my addr 172.21.15.107:0/2921652995 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd1cc700 1 --2- 172.21.15.107:0/2921652995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80d0bd0 0x7f8ff80d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffc9cb700 1 --2- 172.21.15.107:0/2921652995 >> v2:172.21.15.195:3300/0 conn(0x7f8ff80cf980 0x7f8ff815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff77fe700 1 -- 172.21.15.107:0/2921652995 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112089925 0 0) 0x7f8fe4001110 con 0x7f8ff80cddf0 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff77fe700 1 -- 172.21.15.107:0/2921652995 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe80035d0 con 0x7f8ff80cddf0 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd1cc700 1 -- 172.21.15.107:0/2921652995 >> v2:172.21.15.195:3300/0 conn(0x7f8ff80cf980 msgr2=0x7f8ff815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd1cc700 1 --2- 172.21.15.107:0/2921652995 >> v2:172.21.15.195:3300/0 conn(0x7f8ff80cf980 0x7f8ff815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd1cc700 1 -- 172.21.15.107:0/2921652995 >> v1:172.21.15.107:6789/0 conn(0x7f8ff80cddf0 legacy=0x7f8ff80cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:00.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd1cc700 1 -- 172.21.15.107:0/2921652995 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff80ce890 con 0x7f8ff80d0bd0 2024-05-08T20:57:00.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd1cc700 1 --2- 172.21.15.107:0/2921652995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80d0bd0 0x7f8ff80d1040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009d90 tx=0x7f8ff000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2221a81d96c25756 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff77fe700 1 -- 172.21.15.107:0/2921652995 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000e070 con 0x7f8ff80d0bd0 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff77fe700 1 -- 172.21.15.107:0/2921652995 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff000bb20 con 0x7f8ff80d0bd0 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ff77fe700 1 -- 172.21.15.107:0/2921652995 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0012430 con 0x7f8ff80d0bd0 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/2921652995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80d0bd0 msgr2=0x7f8ff80d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/2921652995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80d0bd0 0x7f8ff80d1040 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009d90 tx=0x7f8ff000b330 comp rx=0 tx=0).stop 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/2921652995 shutdown_connections 2024-05-08T20:57:00.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/2921652995 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80d0bd0 0x7f8ff80d1040 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/2921652995 >> v2:172.21.15.195:3300/0 conn(0x7f8ff80cf980 0x7f8ff815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/2921652995 >> 172.21.15.107:0/2921652995 conn(0x7f8ff809c370 msgr2=0x7f8ff80d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:57:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/2921652995 shutdown_connections 2024-05-08T20:57:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.364+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/2921652995 wait complete. 2024-05-08T20:57:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 Processor -- start 2024-05-08T20:57:00.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 -- start start 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff80cddf0 0x7f8ff814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 0x7f8ff809cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ff80d0bd0 0x7f8ff80b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff814f980 con 0x7f8ff80d0bd0 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c6b10 con 0x7f8ff80cddf0 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80c6df0 con 0x7f8ff80cf980 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 0x7f8ff809cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd1cc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ff80d0bd0 0x7f8ff80b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:00.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 0x7f8ff809cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:43162/0 (socket says 172.21.15.107:43162) 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 -- 172.21.15.107:0/253076993 learned_addr learned my addr 172.21.15.107:0/253076993 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffc9cb700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff80cddf0 0x7f8ff814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 -- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff80cddf0 msgr2=0x7f8ff814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff80cddf0 0x7f8ff814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 -- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ff80d0bd0 msgr2=0x7f8ff80b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ff80d0bd0 0x7f8ff80b7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 -- 172.21.15.107:0/253076993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0009a70 con 0x7f8ff80cf980 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff7fff700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 0x7f8ff809cce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c730 tx=0x7f8fe400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:57:00.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4005d90 con 0x7f8ff80cf980 2024-05-08T20:57:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe40070d0 con 0x7f8ff80cf980 2024-05-08T20:57:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4007460 con 0x7f8ff80cf980 2024-05-08T20:57:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff80c70d0 con 0x7f8ff80cf980 2024-05-08T20:57:00.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.368+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff80c7690 con 0x7f8ff80cf980 2024-05-08T20:57:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.372+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff80672a0 con 0x7f8ff80cf980 2024-05-08T20:57:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.372+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fe40075c0 con 0x7f8ff80cf980 2024-05-08T20:57:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.372+0000 7f8ff57fa700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8fdc066760 0x7f8fdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.372+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fe4083900 con 0x7f8ff80cf980 2024-05-08T20:57:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.372+0000 7f8ffc9cb700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8fdc066760 0x7f8fdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:00.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.372+0000 7f8ffc9cb700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8fdc066760 0x7f8fdc068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009bf0 tx=0x7f8fec009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:57:00.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.384+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8fe4050c60 con 0x7f8ff80cf980 2024-05-08T20:57:00.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.588+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ff815e830 con 0x7f8ff80cf980 2024-05-08T20:57:00.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.588+0000 7f8ff57fa700 1 -- 172.21.15.107:0/253076993 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8ff815e830 con 0x7f8ff80cf980 2024-05-08T20:57:00.596 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T20:57:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8fdc066760 msgr2=0x7f8fdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8fdc066760 0x7f8fdc068c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009bf0 tx=0x7f8fec009240 comp rx=0 tx=0).stop 2024-05-08T20:57:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 msgr2=0x7f8ff809cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:00.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 0x7f8ff809cce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c730 tx=0x7f8fe400ca40 comp rx=0 tx=0).stop 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 shutdown_connections 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ff80d0bd0 0x7f8ff80b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8fdc066760 0x7f8fdc068c20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8ff80cf980 0x7f8ff809cce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 --2- 172.21.15.107:0/253076993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff80cddf0 0x7f8ff814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 >> 172.21.15.107:0/253076993 conn(0x7f8ff809c370 msgr2=0x7f8ff8160290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 shutdown_connections 2024-05-08T20:57:00.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:00.592+0000 7f8ffd9cd700 1 -- 172.21.15.107:0/253076993 wait complete. 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T20:57:00.610 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:57:00.611 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:57:00.611 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-08T20:57:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.611 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:57:00.619 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42517sec preferred_lft 42517sec 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:8e:eb:ac:24 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:00.620 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-08T20:57:00.621 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:00.621 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:57:00.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr flush dev ceph-brx 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set ceph-brx up 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:57:00.621 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:00.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.709 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:57:00.718 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-05-08T20:57:00.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.720 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-05-08T20:57:00.743 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-05-08T20:57:00.743 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:57:00.743 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-08T20:57:00.743 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:57:00.744 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-08T20:57:00.744 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-05-08T20:57:00.744 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:57:00.744 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:57:00.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.744 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:00.744 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:00.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:57:00.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:57:00.744 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:57:00.745 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:00.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.787 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-05-08T20:57:00.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.793 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-05-08T20:57:00.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.842 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:00.842 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:00.842 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T20:57:00.842 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-08T20:57:00.842 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:00.876 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-08T20:57:00.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.876 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:00.876 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:00.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-08T20:57:00.876 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:57:00.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-08T20:57:00.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-08T20:57:00.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-08T20:57:00.877 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:00.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:00.941 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:00.941 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:00.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.0 up 2024-05-08T20:57:00.942 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:57:00.942 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:00.969 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-08T20:57:00.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:57:00.970 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-08T20:57:01.018 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-08T20:57:01.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:57:01.018 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-08T20:57:01.024 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-05-08T20:57:01.043 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:57:01.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:57:01.053 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:57:01.053 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:57:01.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:01.054 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-05-08T20:57:01.102 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T20:57:01.102 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-08T20:57:01.104 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-05-08T20:57:01.123 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:57:01.124 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:57:01.179 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:57:01.180 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:57:01.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:01.180 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-05-08T20:57:01.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:2024-05-08T20:57:01.191+0000 7f71841b7640 -1 init, newargv = 0x563945619c90 newargc=15 2024-05-08T20:57:01.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[31698]: starting ceph client 2024-05-08T20:57:01.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[31698]: starting fuse 2024-05-08T20:57:02.288 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-05-08T20:57:02.305 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:57:02.305 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:57:02.362 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:57:02.363 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:57:02.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:02.364 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-05-08T20:57:02.371 INFO:teuthology.orchestra.run.smithi195.stdout:52 2024-05-08T20:57:02.371 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-05-08T20:57:02.371 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:57:02.371 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-05-08T20:57:02.371 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-05-08T20:57:02.372 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.1")) 2024-05-08T20:57:02.373 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-05-08T20:57:02.455 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.1.31698.asok 2024-05-08T20:57:02.639 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.31698.asok 2024-05-08T20:57:02.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:02.639 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.31698.asok status 2024-05-08T20:57:02.786 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T20:57:02.786 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-05-08T20:57:02.786 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:57:02.786 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "1", 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "31698", 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4681, 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-05-08T20:57:02.787 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4681 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2709554843 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.1:0", 2024-05-08T20:57:02.788 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 2709554843 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4681 192.168.0.1:0/2709554843", 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.1:0/2709554843", 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 8, 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 20, 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-05-08T20:57:02.789 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T20:57:02.796 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-08T20:57:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.908+0000 7f0e0e3d1700 1 Processor -- start 2024-05-08T20:57:02.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.908+0000 7f0e0e3d1700 1 -- start start 2024-05-08T20:57:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e080b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0e0815a190 0x7f0e080709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e080b3590 con 0x7f0e080b4e50 2024-05-08T20:57:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e080b24f0 con 0x7f0e0815a190 2024-05-08T20:57:02.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080b27d0 con 0x7f0e081596a0 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0e0815a190 0x7f0e080709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0d3cf700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e080b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f0e0815a190 0x7f0e080709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:57316/0 (socket says 172.21.15.107:57316) 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0cbce700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f0e080b4e50 0x7f0e08159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:55880/0 (socket says 172.21.15.107:55880) 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 -- 172.21.15.107:0/969042437 learned_addr learned my addr 172.21.15.107:0/969042437 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0d3cf700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e080b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:43164/0 (socket says 172.21.15.107:43164) 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 -- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 msgr2=0x7f0e080b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 --2- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e080b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 -- 172.21.15.107:0/969042437 >> v1:172.21.15.195:6789/0 conn(0x7f0e080b4e50 legacy=0x7f0e08159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 -- 172.21.15.107:0/969042437 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080b2ab0 con 0x7f0e0815a190 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0d3cf700 1 --2- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e080b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0dbd0700 1 --2- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e0815a190 0x7f0e080709a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000bbb0 tx=0x7f0e0000bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f515e0f58a7474ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:57:02.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0dfffff700 1 -- 172.21.15.107:0/969042437 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000dd30 con 0x7f0e0815a190 2024-05-08T20:57:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0dfffff700 1 -- 172.21.15.107:0/969042437 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0000de90 con 0x7f0e0815a190 2024-05-08T20:57:02.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0dfffff700 1 -- 172.21.15.107:0/969042437 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00010690 con 0x7f0e0815a190 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e0815a190 msgr2=0x7f0e080709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e0815a190 0x7f0e080709a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000bbb0 tx=0x7f0e0000bec0 comp rx=0 tx=0).stop 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/969042437 shutdown_connections 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e0815a190 0x7f0e080709a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/969042437 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e080b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/969042437 >> 172.21.15.107:0/969042437 conn(0x7f0e0806c330 msgr2=0x7f0e0806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:57:02.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/969042437 shutdown_connections 2024-05-08T20:57:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.912+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/969042437 wait complete. 2024-05-08T20:57:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 Processor -- start 2024-05-08T20:57:02.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 -- start start 2024-05-08T20:57:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e080b4e50 0x7f0e081f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:02.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e0806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 0x7f0e08152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080af9a0 con 0x7f0e0815a190 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080afc80 con 0x7f0e080b4e50 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080aff60 con 0x7f0e081596a0 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0dbd0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 0x7f0e08152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e0806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0dbd0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 0x7f0e08152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:51878/0 (socket says 172.21.15.107:51878) 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0dbd0700 1 -- 172.21.15.107:0/2687727574 learned_addr learned my addr 172.21.15.107:0/2687727574 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0d3cf700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e080b4e50 0x7f0e081f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 -- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e080b4e50 msgr2=0x7f0e081f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e080b4e50 0x7f0e081f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 -- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 msgr2=0x7f0e08152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 0x7f0e08152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:02.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 -- 172.21.15.107:0/2687727574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80094b0 con 0x7f0e081596a0 2024-05-08T20:57:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0dbd0700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 0x7f0e08152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:57:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0cbce700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e0806d760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400caf0 tx=0x7f0e0400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:57:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0400a9e0 con 0x7f0e081596a0 2024-05-08T20:57:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0000b810 con 0x7f0e081596a0 2024-05-08T20:57:02.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0400ab40 con 0x7f0e081596a0 2024-05-08T20:57:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e080b0520 con 0x7f0e081596a0 2024-05-08T20:57:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.916+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e04007070 con 0x7f0e081596a0 2024-05-08T20:57:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.920+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e080b06b0 con 0x7f0e081596a0 2024-05-08T20:57:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.920+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e040071d0 con 0x7f0e081596a0 2024-05-08T20:57:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.920+0000 7f0dfdffb700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0dec066730 0x7f0dec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:57:02.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.920+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e04083e50 con 0x7f0e081596a0 2024-05-08T20:57:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.920+0000 7f0e0d3cf700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0dec066730 0x7f0dec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:57:02.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.920+0000 7f0e0d3cf700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0dec066730 0x7f0dec068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009ce0 tx=0x7f0df8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:57:02.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:02.928+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f0e040510c0 con 0x7f0e081596a0 2024-05-08T20:57:03.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.136+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e080684b0 con 0x7f0e081596a0 2024-05-08T20:57:03.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.140+0000 7f0dfdffb700 1 -- 172.21.15.107:0/2687727574 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0e04085060 con 0x7f0e081596a0 2024-05-08T20:57:03.146 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T20:57:03.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0dec066730 msgr2=0x7f0dec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:03.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0dec066730 0x7f0dec068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009ce0 tx=0x7f0df8009240 comp rx=0 tx=0).stop 2024-05-08T20:57:03.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 msgr2=0x7f0e0806d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:57:03.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e0806d760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e0400caf0 tx=0x7f0e0400ce00 comp rx=0 tx=0).stop 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 shutdown_connections 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0815a190 0x7f0e08152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0dec066730 0x7f0dec068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0e081596a0 0x7f0e0806d760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 --2- 172.21.15.107:0/2687727574 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0e080b4e50 0x7f0e081f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 >> 172.21.15.107:0/2687727574 conn(0x7f0e0806c330 msgr2=0x7f0e08158780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 shutdown_connections 2024-05-08T20:57:03.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:57:03.144+0000 7f0e0e3d1700 1 -- 172.21.15.107:0/2687727574 wait complete. 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi195.front.sepia.ceph.com 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:57:03.165 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-08T20:57:03.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.166 DEBUG:teuthology.orchestra.run.smithi195:> ip addr 2024-05-08T20:57:03.174 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:57:03.174 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:57:03.174 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:57:03.174 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.174 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f0 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:d9:36:f1 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:80 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 0c:c4:7a:88:80:81 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.21.15.195/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft 42515sec preferred_lft 42515sec 2024-05-08T20:57:03.175 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::ec4:7aff:fe88:8081/64 scope link 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 02:42:8e:eb:ac:24 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 42:3c:07:fd:a1:64 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::6402:7fff:fe0a:f81d/64 scope link 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-08T20:57:03.176 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 42:3c:07:fd:a1:64 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T20:57:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::403c:7ff:fefd:a164/64 scope link 2024-05-08T20:57:03.177 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.177 DEBUG:teuthology.orchestra.run.smithi195:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:57:03.192 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-05-08T20:57:03.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.194 DEBUG:teuthology.orchestra.run.smithi195:> route 2024-05-08T20:57:03.243 INFO:teuthology.orchestra.run.smithi195.stdout:Kernel IP routing table 2024-05-08T20:57:03.243 INFO:teuthology.orchestra.run.smithi195.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run.smithi195.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run.smithi195.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run.smithi195.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run.smithi195.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:57:03.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.244 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:03.244 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:03.245 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T20:57:03.245 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T20:57:03.245 DEBUG:teuthology.orchestra.run.smithi195:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T20:57:03.245 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:03.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.287 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-05-08T20:57:03.294 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T20:57:03.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.295 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list-id 2024-05-08T20:57:03.301 INFO:teuthology.orchestra.run.smithi195.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-08T20:57:03.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.301 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:03.301 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:03.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T20:57:03.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-08T20:57:03.302 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:03.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.375 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T20:57:03.391 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 6e:6b:bd:b6:b9:aa brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::6c6b:bdff:feb6:b9aa/64 scope link 2024-05-08T20:57:03.392 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.394 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 ::1/128 scope host 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-08T20:57:03.408 INFO:teuthology.orchestra.run.smithi195.stdout: link/ether 6e:6b:bd:b6:b9:aa brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-08T20:57:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-08T20:57:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: inet6 fe80::6c6b:bdff:feb6:b9aa/64 scope link 2024-05-08T20:57:03.409 INFO:teuthology.orchestra.run.smithi195.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:57:03.410 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-08T20:57:03.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-08T20:57:03.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-08T20:57:03.411 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:03.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.506 DEBUG:teuthology.orchestra.run.smithi195:> (cd / && exec bash -c ' 2024-05-08T20:57:03.506 DEBUG:teuthology.orchestra.run.smithi195:> set -e 2024-05-08T20:57:03.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set brx.1 up 2024-05-08T20:57:03.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link set dev brx.1 master ceph-brx 2024-05-08T20:57:03.506 DEBUG:teuthology.orchestra.run.smithi195:> ') 2024-05-08T20:57:03.532 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-08T20:57:03.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:57:03.533 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-08T20:57:03.538 INFO:teuthology.orchestra.run.smithi195.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-08T20:57:03.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:57:03.539 DEBUG:teuthology.orchestra.run.smithi195:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-08T20:57:03.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-05-08T20:57:03.607 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:57:03.607 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:57:03.621 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:57:03.621 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:57:03.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.622 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-05-08T20:57:03.628 INFO:teuthology.orchestra.run.smithi195.stdout:52 2024-05-08T20:57:03.628 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [52] 2024-05-08T20:57:03.628 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-08T20:57:03.672 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-05-08T20:57:03.691 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:57:03.691 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:57:03.700 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:57:03.701 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:57:03.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:03.702 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-05-08T20:57:03.707 INFO:teuthology.orchestra.run.smithi195.stdout:52 2024-05-08T20:57:03.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:2024-05-08T20:57:03.755+0000 7f4737bbf640 -1 init, newargv = 0x561526110d00 newargc=15 2024-05-08T20:57:03.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[31815]: starting ceph client 2024-05-08T20:57:03.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[31815]: starting fuse 2024-05-08T20:57:04.809 DEBUG:teuthology.orchestra.run.smithi195:> sudo modprobe fuse 2024-05-08T20:57:04.828 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-08T20:57:04.828 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-08T20:57:04.888 INFO:teuthology.orchestra.run.smithi195.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-08T20:57:04.889 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-08T20:57:04.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:04.890 DEBUG:teuthology.orchestra.run.smithi195:> ls /sys/fs/fuse/connections 2024-05-08T20:57:04.897 INFO:teuthology.orchestra.run.smithi195.stdout:52 2024-05-08T20:57:04.897 INFO:teuthology.orchestra.run.smithi195.stdout:53 2024-05-08T20:57:04.897 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52, 53] 2024-05-08T20:57:04.897 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-08T20:57:04.897 DEBUG:teuthology.orchestra.run.smithi195:> import glob 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> import re 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> import os 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> import subprocess 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> def _find_admin_socket(client_name): 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> files = glob.glob(asok_path) 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> # Given a non-glob path, it better be there 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> if "*" not in asok_path: 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> assert(len(files) == 1) 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> return files[0] 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:04.898 DEBUG:teuthology.orchestra.run.smithi195:> for f in files: 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> contents = proc_f.read() 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> if mountpoint in contents: 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> return f 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> print(_find_admin_socket("client.3")) 2024-05-08T20:57:04.899 DEBUG:teuthology.orchestra.run.smithi195:> ' 2024-05-08T20:57:04.981 INFO:teuthology.orchestra.run.smithi195.stdout:/var/run/ceph/ceph-client.3.31815.asok 2024-05-08T20:57:05.165 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.31815.asok 2024-05-08T20:57:05.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.166 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.31815.asok status 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "metadata": { 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_sha1": "d21e4f961318b56f0d915caa2490c3711bf13c34", 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "entity_id": "3", 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "hostname": "smithi195", 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "pid": "31815", 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "root": "/" 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_count": 0, 2024-05-08T20:57:05.309 INFO:teuthology.orchestra.run.smithi195.stdout: "dentry_pinned_count": 0, 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "id": 4699, 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "inst": { 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "name": { 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "client", 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "num": 4699 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.2:0", 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 3720686362 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": { 2024-05-08T20:57:05.310 INFO:teuthology.orchestra.run.smithi195.stdout: "type": "v1", 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "addr": "192.168.0.2:0", 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "nonce": 3720686362 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "inst_str": "client.4699 192.168.0.2:0/3720686362", 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "addr_str": "192.168.0.2:0/3720686362", 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "inode_count": 1, 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_epoch": 8, 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch": 20, 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_epoch_barrier": 0, 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "blocklisted": false, 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout: "fs_name": "cephfs" 2024-05-08T20:57:05.311 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-05-08T20:57:05.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.318 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2024-05-08T20:57:05.318 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:57:05.327 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2024-05-08T20:57:05.327 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T20:57:05.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:57:05.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.345 DEBUG:teuthology.orchestra.run.smithi107:> stat --file-system '--printf=%T 2024-05-08T20:57:05.345 DEBUG:teuthology.orchestra.run.smithi107:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-08T20:57:05.352 INFO:teuthology.orchestra.run.smithi107.stdout:fuseblk 2024-05-08T20:57:05.352 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-08T20:57:05.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-08T20:57:05.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.410 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-05-08T20:57:05.410 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-08T20:57:05.420 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-05-08T20:57:05.421 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-08T20:57:05.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.421 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-08T20:57:05.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.433 DEBUG:teuthology.orchestra.run.smithi195:> stat --file-system '--printf=%T 2024-05-08T20:57:05.433 DEBUG:teuthology.orchestra.run.smithi195:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-08T20:57:05.482 INFO:teuthology.orchestra.run.smithi195.stdout:fuseblk 2024-05-08T20:57:05.482 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-08T20:57:05.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:57:05.483 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-08T20:57:05.499 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T20:57:05.511 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:57:05.511 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T20:57:05.512 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 34h/52d Inode: 1 Links: 2 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-08 20:56:41.775052714 +0000 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-08 20:57:05.338895739 +0000 2024-05-08T20:57:05.522 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-08T20:57:05.523 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T20:57:05.523 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T20:57:05.596 INFO:tasks.workunit:timeout=3h 2024-05-08T20:57:05.596 INFO:tasks.workunit:cleanup=True 2024-05-08T20:57:05.597 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:57:05.605 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T20:57:10.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:10.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:40.516 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:57:40.520 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:10.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:10.715 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.447 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-08T20:58:33.448 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:58:33.452 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T20:58:33.512 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T20:58:33.516 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:58:33.516 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T20:58:34.393 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T20:58:34.475 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T20:58:34.537 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:58:34.540 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:58:34.540 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T20:58:34.597 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:58:34.603 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:58:34.603 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T20:58:34.609 INFO:tasks.workunit:Running workunits matching fs/maxentries on client.0... 2024-05-08T20:58:34.610 INFO:tasks.workunit:Running workunit fs/maxentries/maxentries.sh... 2024-05-08T20:58:34.610 DEBUG:teuthology.orchestra.run.smithi107:workunit test fs/maxentries/maxentries.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/maxentries/maxentries.sh 2024-05-08T20:58:34.635 INFO:tasks.workunit.client.0.smithi107.stderr:+ test_dir=max_entries 2024-05-08T20:58:34.636 INFO:tasks.workunit.client.0.smithi107.stderr:+ mkdir -p max_entries 2024-05-08T20:58:34.641 INFO:tasks.workunit.client.0.smithi107.stderr:+ pushd max_entries 2024-05-08T20:58:34.644 INFO:tasks.workunit.client.0.smithi107.stdout:~/cephtest/mnt.0/client.0/tmp/max_entries ~/cephtest/mnt.0/client.0/tmp 2024-05-08T20:58:34.644 INFO:tasks.workunit.client.0.smithi107.stderr:+ dir_max_entries=100 2024-05-08T20:58:34.644 INFO:tasks.workunit.client.0.smithi107.stderr:+ ceph config set mds mds_dir_max_entries 100 2024-05-08T20:58:34.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.750+0000 7f78b4b51700 1 Processor -- start 2024-05-08T20:58:34.756 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.750+0000 7f78b4b51700 1 -- start start 2024-05-08T20:58:34.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b015a320 0x7f78b015a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:34.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b015e8e0 con 0x7f78b0072800 2024-05-08T20:58:34.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00b2e40 con 0x7f78b0070ea0 2024-05-08T20:58:34.759 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00700b0 con 0x7f78b015a320 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78add9b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f78b0072800 0x7f78b0070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:46998/0 (socket says 172.21.15.107:46998) 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78add9b700 1 -- 172.21.15.107:0/3079792449 learned_addr learned my addr 172.21.15.107:0/3079792449 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ae59c700 1 --2- 172.21.15.107:0/3079792449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b015a320 0x7f78b015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236198911 0 0) 0x7f78b015e8e0 con 0x7f78b0072800 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78980035d0 con 0x7f78b0072800 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135985792 0 0) 0x7f78b00b2e40 con 0x7f78b0070ea0 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b015e8e0 con 0x7f78b0070ea0 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ae59c700 1 -- 172.21.15.107:0/3079792449 >> v1:172.21.15.195:6789/0 conn(0x7f78b0070ea0 legacy=0x7f78b006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ae59c700 1 -- 172.21.15.107:0/3079792449 >> v1:172.21.15.107:6789/0 conn(0x7f78b0072800 legacy=0x7f78b0070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363833259 0 0) 0x7f78980035d0 con 0x7f78b0072800 2024-05-08T20:58:34.760 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ae59c700 1 -- 172.21.15.107:0/3079792449 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b015eb40 con 0x7f78b015a320 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ae59c700 1 --2- 172.21.15.107:0/3079792449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b015a320 0x7f78b015a700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009880 tx=0x7f78a0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39df88b21d9199c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a000f8a0 con 0x7f78b015a320 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a000fa00 con 0x7f78b015a320 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78ad59a700 1 -- 172.21.15.107:0/3079792449 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a000fd90 con 0x7f78b015a320 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- 172.21.15.107:0/3079792449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b015a320 msgr2=0x7f78b015a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3079792449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b015a320 0x7f78b015a700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009880 tx=0x7f78a0009b90 comp rx=0 tx=0).stop 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- 172.21.15.107:0/3079792449 shutdown_connections 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3079792449 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b015a320 0x7f78b015a700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- 172.21.15.107:0/3079792449 >> 172.21.15.107:0/3079792449 conn(0x7f78b00b1de0 msgr2=0x7f78b00b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:58:34.762 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- 172.21.15.107:0/3079792449 shutdown_connections 2024-05-08T20:58:34.763 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.754+0000 7f78b4b51700 1 -- 172.21.15.107:0/3079792449 wait complete. 2024-05-08T20:58:34.764 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.758+0000 7f78b4b51700 1 Processor -- start 2024-05-08T20:58:34.765 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.758+0000 7f78b4b51700 1 -- start start 2024-05-08T20:58:34.768 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b0070ea0 0x7f78b00af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b0072800 0x7f78b00ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 0x7f78b014c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b01517d0 con 0x7f78b015a320 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0150920 con 0x7f78b0072800 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0150bc0 con 0x7f78b0070ea0 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 0x7f78b014c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78ae59c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b0070ea0 0x7f78b00af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78ae59c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b0070ea0 0x7f78b00af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:37170/0 (socket says 172.21.15.107:37170) 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78ae59c700 1 -- 172.21.15.107:0/3073560605 learned_addr learned my addr 172.21.15.107:0/3073560605 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 0x7f78b014c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36562/0 (socket says 172.21.15.107:36562) 2024-05-08T20:58:34.769 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78add9b700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b0072800 0x7f78b00ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 -- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b0070ea0 msgr2=0x7f78b00af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b0070ea0 0x7f78b00af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 -- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b0072800 msgr2=0x7f78b00ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b0072800 0x7f78b00ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 -- 172.21.15.107:0/3073560605 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00094b0 con 0x7f78b015a320 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78aed9d700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 0x7f78b014c510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f78b006c3d0 tx=0x7f78a800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8003c20 con 0x7f78b015a320 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a8003d80 con 0x7f78b015a320 2024-05-08T20:58:34.770 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b0150ea0 con 0x7f78b015a320 2024-05-08T20:58:34.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a800a990 con 0x7f78b015a320 2024-05-08T20:58:34.771 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.762+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b0151460 con 0x7f78b015a320 2024-05-08T20:58:34.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.766+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b00686b0 con 0x7f78b015a320 2024-05-08T20:58:34.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.766+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f78a800aaf0 con 0x7f78b015a320 2024-05-08T20:58:34.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.766+0000 7f789effd700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7890066730 0x7f7890068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:34.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.766+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f78a8084110 con 0x7f78b015a320 2024-05-08T20:58:34.772 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.766+0000 7f78ae59c700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7890066730 0x7f7890068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:34.773 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.766+0000 7f78ae59c700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7890066730 0x7f7890068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009bd0 tx=0x7f78a001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:58:34.780 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.774+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f78a80513b0 con 0x7f78b015a320 2024-05-08T20:58:34.952 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.946+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7f78b00712c0 con 0x7f78b015a320 2024-05-08T20:58:34.959 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:34.954+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v10)=0 v10) v1 ==== 119+0+0 (secure 0 0 0) 0x7f78a80549d0 con 0x7f78b015a320 2024-05-08T20:58:35.060 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.054+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7f78b006e680 con 0x7f78b015a320 2024-05-08T20:58:35.061 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.054+0000 7f789effd700 1 -- 172.21.15.107:0/3073560605 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v10)=0 v10) v1 ==== 119+0+0 (secure 0 0 0) 0x7f78a8054bb0 con 0x7f78b015a320 2024-05-08T20:58:35.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7890066730 msgr2=0x7f7890068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:35.063 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7890066730 0x7f7890068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009bd0 tx=0x7f78a001c040 comp rx=0 tx=0).stop 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 msgr2=0x7f78b014c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 0x7f78b014c510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f78b006c3d0 tx=0x7f78a800ce70 comp rx=0 tx=0).stop 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 shutdown_connections 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78b015a320 0x7f78b014c510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f78b0072800 0x7f78b00ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7890066730 0x7f7890068bf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 --2- 172.21.15.107:0/3073560605 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f78b0070ea0 0x7f78b00af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 >> 172.21.15.107:0/3073560605 conn(0x7f78b00b1de0 msgr2=0x7f78b006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 shutdown_connections 2024-05-08T20:58:35.064 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:35.058+0000 7f78b4b51700 1 -- 172.21.15.107:0/3073560605 wait complete. 2024-05-08T20:58:35.074 INFO:tasks.workunit.client.0.smithi107.stderr:+ ok_dir_max_entries=100 2024-05-08T20:58:35.075 INFO:tasks.workunit.client.0.smithi107.stderr:+ fail_dir_max_entries=101 2024-05-08T20:58:35.075 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_files 100 2024-05-08T20:58:35.075 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:35.094 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.094 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.095 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00797048 s, 0.0 kB/s 2024-05-08T20:58:35.104 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.105 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.105 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0035338 s, 0.0 kB/s 2024-05-08T20:58:35.115 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.115 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.115 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00434464 s, 0.0 kB/s 2024-05-08T20:58:35.126 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.126 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.126 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00435429 s, 0.0 kB/s 2024-05-08T20:58:35.137 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.138 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.138 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478276 s, 0.0 kB/s 2024-05-08T20:58:35.149 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.149 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.150 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00452557 s, 0.0 kB/s 2024-05-08T20:58:35.161 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.162 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00456939 s, 0.0 kB/s 2024-05-08T20:58:35.173 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.173 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.174 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0045244 s, 0.0 kB/s 2024-05-08T20:58:35.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.186 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502569 s, 0.0 kB/s 2024-05-08T20:58:35.198 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.198 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.198 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00448518 s, 0.0 kB/s 2024-05-08T20:58:35.210 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.210 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.210 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466105 s, 0.0 kB/s 2024-05-08T20:58:35.221 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.221 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.222 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00451544 s, 0.0 kB/s 2024-05-08T20:58:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.233 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00444553 s, 0.0 kB/s 2024-05-08T20:58:35.245 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.245 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.245 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048386 s, 0.0 kB/s 2024-05-08T20:58:35.257 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.257 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.257 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00442132 s, 0.0 kB/s 2024-05-08T20:58:35.269 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.270 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.270 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488394 s, 0.0 kB/s 2024-05-08T20:58:35.282 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.282 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.282 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00470499 s, 0.0 kB/s 2024-05-08T20:58:35.295 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.295 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.295 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481413 s, 0.0 kB/s 2024-05-08T20:58:35.307 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.307 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.307 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00449687 s, 0.0 kB/s 2024-05-08T20:58:35.320 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.320 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.320 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00484879 s, 0.0 kB/s 2024-05-08T20:58:35.332 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.332 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.332 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00459675 s, 0.0 kB/s 2024-05-08T20:58:35.344 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.344 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.344 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494484 s, 0.0 kB/s 2024-05-08T20:58:35.356 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.356 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.356 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00440612 s, 0.0 kB/s 2024-05-08T20:58:35.369 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.369 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.369 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052626 s, 0.0 kB/s 2024-05-08T20:58:35.381 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.381 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.381 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00491393 s, 0.0 kB/s 2024-05-08T20:58:35.393 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.393 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.393 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00489869 s, 0.0 kB/s 2024-05-08T20:58:35.405 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.405 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.406 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00492899 s, 0.0 kB/s 2024-05-08T20:58:35.419 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.419 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.419 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500856 s, 0.0 kB/s 2024-05-08T20:58:35.431 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.431 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.431 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047363 s, 0.0 kB/s 2024-05-08T20:58:35.443 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.443 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.443 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478028 s, 0.0 kB/s 2024-05-08T20:58:35.456 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.456 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.456 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0044863 s, 0.0 kB/s 2024-05-08T20:58:35.469 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.469 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.469 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494861 s, 0.0 kB/s 2024-05-08T20:58:35.482 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.482 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.482 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00456259 s, 0.0 kB/s 2024-05-08T20:58:35.495 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.495 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.495 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478017 s, 0.0 kB/s 2024-05-08T20:58:35.508 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.508 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.508 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00455637 s, 0.0 kB/s 2024-05-08T20:58:35.521 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.521 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.521 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481777 s, 0.0 kB/s 2024-05-08T20:58:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.534 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488047 s, 0.0 kB/s 2024-05-08T20:58:35.547 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.548 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.548 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048489 s, 0.0 kB/s 2024-05-08T20:58:35.560 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.560 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.560 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00516067 s, 0.0 kB/s 2024-05-08T20:58:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.573 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481821 s, 0.0 kB/s 2024-05-08T20:58:35.585 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.585 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.585 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00471404 s, 0.0 kB/s 2024-05-08T20:58:35.597 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.597 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.597 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046964 s, 0.0 kB/s 2024-05-08T20:58:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.610 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00548588 s, 0.0 kB/s 2024-05-08T20:58:35.622 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.623 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.623 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00462784 s, 0.0 kB/s 2024-05-08T20:58:35.635 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.635 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.635 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00514696 s, 0.0 kB/s 2024-05-08T20:58:35.648 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.648 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.648 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00526487 s, 0.0 kB/s 2024-05-08T20:58:35.660 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.660 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.661 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00498692 s, 0.0 kB/s 2024-05-08T20:58:35.673 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.673 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.673 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00503465 s, 0.0 kB/s 2024-05-08T20:58:35.685 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.685 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.685 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506486 s, 0.0 kB/s 2024-05-08T20:58:35.697 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.697 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.697 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00449743 s, 0.0 kB/s 2024-05-08T20:58:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.710 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0053985 s, 0.0 kB/s 2024-05-08T20:58:35.723 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.723 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.723 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00457417 s, 0.0 kB/s 2024-05-08T20:58:35.735 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.735 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.736 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494833 s, 0.0 kB/s 2024-05-08T20:58:35.747 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.747 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.748 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00451823 s, 0.0 kB/s 2024-05-08T20:58:35.760 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.760 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.760 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513214 s, 0.0 kB/s 2024-05-08T20:58:35.771 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.772 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.772 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00427512 s, 0.0 kB/s 2024-05-08T20:58:35.784 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.784 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.784 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494215 s, 0.0 kB/s 2024-05-08T20:58:35.795 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.796 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.796 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00451052 s, 0.0 kB/s 2024-05-08T20:58:35.808 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.808 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.808 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00464233 s, 0.0 kB/s 2024-05-08T20:58:35.820 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.820 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.820 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488305 s, 0.0 kB/s 2024-05-08T20:58:35.832 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.833 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.833 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511737 s, 0.0 kB/s 2024-05-08T20:58:35.844 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.845 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.845 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.004547 s, 0.0 kB/s 2024-05-08T20:58:35.857 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.857 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.857 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525011 s, 0.0 kB/s 2024-05-08T20:58:35.870 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.870 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.870 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00464656 s, 0.0 kB/s 2024-05-08T20:58:35.882 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.882 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.882 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00491359 s, 0.0 kB/s 2024-05-08T20:58:35.897 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.897 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.898 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00747778 s, 0.0 kB/s 2024-05-08T20:58:35.910 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.910 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.910 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483602 s, 0.0 kB/s 2024-05-08T20:58:35.923 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.923 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.923 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480456 s, 0.0 kB/s 2024-05-08T20:58:35.936 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.936 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.936 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00526219 s, 0.0 kB/s 2024-05-08T20:58:35.948 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.948 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.948 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495005 s, 0.0 kB/s 2024-05-08T20:58:35.960 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.961 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.961 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478968 s, 0.0 kB/s 2024-05-08T20:58:35.971 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.971 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.971 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00435135 s, 0.0 kB/s 2024-05-08T20:58:35.982 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.982 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.982 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00426321 s, 0.0 kB/s 2024-05-08T20:58:35.993 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:35.994 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:35.994 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00485262 s, 0.0 kB/s 2024-05-08T20:58:36.006 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.006 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.006 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480941 s, 0.0 kB/s 2024-05-08T20:58:36.017 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.018 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.018 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513663 s, 0.0 kB/s 2024-05-08T20:58:36.030 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.030 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.030 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493694 s, 0.0 kB/s 2024-05-08T20:58:36.042 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.042 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.042 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00504254 s, 0.0 kB/s 2024-05-08T20:58:36.054 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.055 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.055 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0051844 s, 0.0 kB/s 2024-05-08T20:58:36.067 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.067 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.067 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00526466 s, 0.0 kB/s 2024-05-08T20:58:36.080 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.080 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.080 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00484112 s, 0.0 kB/s 2024-05-08T20:58:36.094 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.094 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.094 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00562292 s, 0.0 kB/s 2024-05-08T20:58:36.107 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.107 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.107 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501113 s, 0.0 kB/s 2024-05-08T20:58:36.118 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.119 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.119 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00446275 s, 0.0 kB/s 2024-05-08T20:58:36.131 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.131 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.131 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00527021 s, 0.0 kB/s 2024-05-08T20:58:36.143 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.144 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.144 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00499709 s, 0.0 kB/s 2024-05-08T20:58:36.156 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.156 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.156 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00503733 s, 0.0 kB/s 2024-05-08T20:58:36.168 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.168 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.168 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00456744 s, 0.0 kB/s 2024-05-08T20:58:36.181 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.181 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.181 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517714 s, 0.0 kB/s 2024-05-08T20:58:36.193 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.194 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.194 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478044 s, 0.0 kB/s 2024-05-08T20:58:36.207 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.207 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.207 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00527504 s, 0.0 kB/s 2024-05-08T20:58:36.218 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.219 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.219 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00450194 s, 0.0 kB/s 2024-05-08T20:58:36.231 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.231 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.231 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480303 s, 0.0 kB/s 2024-05-08T20:58:36.244 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.244 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.244 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00429527 s, 0.0 kB/s 2024-05-08T20:58:36.256 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.256 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.256 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00492443 s, 0.0 kB/s 2024-05-08T20:58:36.268 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.268 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.268 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0045009 s, 0.0 kB/s 2024-05-08T20:58:36.280 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.280 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.280 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00464493 s, 0.0 kB/s 2024-05-08T20:58:36.292 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.293 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.293 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00465942 s, 0.0 kB/s 2024-05-08T20:58:36.305 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.305 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.305 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00479963 s, 0.0 kB/s 2024-05-08T20:58:36.317 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.317 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.317 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00442447 s, 0.0 kB/s 2024-05-08T20:58:36.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:36.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ expect_false make_files 101 2024-05-08T20:58:36.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ set -x 2024-05-08T20:58:36.320 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_files 101 2024-05-08T20:58:36.321 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:36.338 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.338 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.338 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0054619 s, 0.0 kB/s 2024-05-08T20:58:36.350 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.350 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.350 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00465353 s, 0.0 kB/s 2024-05-08T20:58:36.363 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.363 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.363 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00465416 s, 0.0 kB/s 2024-05-08T20:58:36.375 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.375 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.375 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00477348 s, 0.0 kB/s 2024-05-08T20:58:36.387 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.387 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.387 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00443657 s, 0.0 kB/s 2024-05-08T20:58:36.399 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.399 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.400 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0049359 s, 0.0 kB/s 2024-05-08T20:58:36.412 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.412 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.412 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00461753 s, 0.0 kB/s 2024-05-08T20:58:36.424 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.425 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.425 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486463 s, 0.0 kB/s 2024-05-08T20:58:36.437 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.437 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.437 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473254 s, 0.0 kB/s 2024-05-08T20:58:36.449 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.449 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.449 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00436323 s, 0.0 kB/s 2024-05-08T20:58:36.461 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.461 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.461 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00462913 s, 0.0 kB/s 2024-05-08T20:58:36.473 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.473 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.473 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00444133 s, 0.0 kB/s 2024-05-08T20:58:36.485 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.485 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.485 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00472699 s, 0.0 kB/s 2024-05-08T20:58:36.497 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.497 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.497 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00454343 s, 0.0 kB/s 2024-05-08T20:58:36.509 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.509 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.509 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00479816 s, 0.0 kB/s 2024-05-08T20:58:36.522 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.523 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.523 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00458483 s, 0.0 kB/s 2024-05-08T20:58:36.534 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.535 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.535 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00482463 s, 0.0 kB/s 2024-05-08T20:58:36.546 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.546 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.546 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00435193 s, 0.0 kB/s 2024-05-08T20:58:36.559 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.559 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.559 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00470011 s, 0.0 kB/s 2024-05-08T20:58:36.571 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.571 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.571 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0045303 s, 0.0 kB/s 2024-05-08T20:58:36.584 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.584 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.584 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495073 s, 0.0 kB/s 2024-05-08T20:58:36.596 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.596 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.597 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00448041 s, 0.0 kB/s 2024-05-08T20:58:36.610 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.610 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.610 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496206 s, 0.0 kB/s 2024-05-08T20:58:36.621 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.621 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.622 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00450993 s, 0.0 kB/s 2024-05-08T20:58:36.633 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.633 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.633 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00476191 s, 0.0 kB/s 2024-05-08T20:58:36.645 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.646 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.646 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00454707 s, 0.0 kB/s 2024-05-08T20:58:36.657 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.658 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.658 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00453565 s, 0.0 kB/s 2024-05-08T20:58:36.669 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.670 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.670 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00449186 s, 0.0 kB/s 2024-05-08T20:58:36.682 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.683 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.683 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473107 s, 0.0 kB/s 2024-05-08T20:58:36.696 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.696 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.696 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046538 s, 0.0 kB/s 2024-05-08T20:58:36.708 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.708 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.708 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473992 s, 0.0 kB/s 2024-05-08T20:58:36.720 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.721 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.721 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478673 s, 0.0 kB/s 2024-05-08T20:58:36.733 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.734 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.734 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00567331 s, 0.0 kB/s 2024-05-08T20:58:36.746 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.746 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.746 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00462993 s, 0.0 kB/s 2024-05-08T20:58:36.758 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.758 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.758 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501911 s, 0.0 kB/s 2024-05-08T20:58:36.771 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.771 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.771 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00472642 s, 0.0 kB/s 2024-05-08T20:58:36.782 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.782 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.782 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00457981 s, 0.0 kB/s 2024-05-08T20:58:36.795 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.795 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.795 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483734 s, 0.0 kB/s 2024-05-08T20:58:36.807 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.807 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.807 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00465152 s, 0.0 kB/s 2024-05-08T20:58:36.819 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.819 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.820 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467992 s, 0.0 kB/s 2024-05-08T20:58:36.831 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.831 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.831 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00438058 s, 0.0 kB/s 2024-05-08T20:58:36.843 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.843 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.843 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046611 s, 0.0 kB/s 2024-05-08T20:58:36.855 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.855 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.855 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00440211 s, 0.0 kB/s 2024-05-08T20:58:36.867 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.867 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.867 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00462156 s, 0.0 kB/s 2024-05-08T20:58:36.878 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.878 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.878 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00433577 s, 0.0 kB/s 2024-05-08T20:58:36.891 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.891 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.891 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0049451 s, 0.0 kB/s 2024-05-08T20:58:36.903 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.904 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.904 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00438435 s, 0.0 kB/s 2024-05-08T20:58:36.915 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.915 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.915 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486301 s, 0.0 kB/s 2024-05-08T20:58:36.928 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.928 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.928 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490354 s, 0.0 kB/s 2024-05-08T20:58:36.940 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.940 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.940 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00485123 s, 0.0 kB/s 2024-05-08T20:58:36.952 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.952 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.952 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00459105 s, 0.0 kB/s 2024-05-08T20:58:36.965 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.965 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.965 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515187 s, 0.0 kB/s 2024-05-08T20:58:36.977 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.977 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.977 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00440828 s, 0.0 kB/s 2024-05-08T20:58:36.989 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:36.989 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:36.989 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466957 s, 0.0 kB/s 2024-05-08T20:58:37.000 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.000 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.000 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0043491 s, 0.0 kB/s 2024-05-08T20:58:37.012 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.012 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.012 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00463955 s, 0.0 kB/s 2024-05-08T20:58:37.024 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.024 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.024 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00446309 s, 0.0 kB/s 2024-05-08T20:58:37.036 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.036 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.036 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047177 s, 0.0 kB/s 2024-05-08T20:58:37.049 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.049 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.049 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00463634 s, 0.0 kB/s 2024-05-08T20:58:37.061 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.061 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.061 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494477 s, 0.0 kB/s 2024-05-08T20:58:37.074 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.074 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.074 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467596 s, 0.0 kB/s 2024-05-08T20:58:37.086 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.086 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.086 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00487519 s, 0.0 kB/s 2024-05-08T20:58:37.098 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.098 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.098 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00461651 s, 0.0 kB/s 2024-05-08T20:58:37.113 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.113 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.113 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00714675 s, 0.0 kB/s 2024-05-08T20:58:37.126 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.126 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.126 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00463896 s, 0.0 kB/s 2024-05-08T20:58:37.138 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.138 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.138 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00450453 s, 0.0 kB/s 2024-05-08T20:58:37.150 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.150 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.150 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00472966 s, 0.0 kB/s 2024-05-08T20:58:37.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.163 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00440261 s, 0.0 kB/s 2024-05-08T20:58:37.174 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.175 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.175 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500891 s, 0.0 kB/s 2024-05-08T20:58:37.187 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.187 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.188 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466223 s, 0.0 kB/s 2024-05-08T20:58:37.200 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.200 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.200 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00492823 s, 0.0 kB/s 2024-05-08T20:58:37.212 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.213 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.213 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494624 s, 0.0 kB/s 2024-05-08T20:58:37.225 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.225 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.225 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480754 s, 0.0 kB/s 2024-05-08T20:58:37.237 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.237 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.237 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00485267 s, 0.0 kB/s 2024-05-08T20:58:37.250 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.250 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.250 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517083 s, 0.0 kB/s 2024-05-08T20:58:37.262 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.262 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.263 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467553 s, 0.0 kB/s 2024-05-08T20:58:37.275 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.275 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.275 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495774 s, 0.0 kB/s 2024-05-08T20:58:37.289 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.289 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.289 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00654141 s, 0.0 kB/s 2024-05-08T20:58:37.302 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.302 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.302 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507706 s, 0.0 kB/s 2024-05-08T20:58:37.314 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.314 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.314 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473191 s, 0.0 kB/s 2024-05-08T20:58:37.327 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.327 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.327 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486052 s, 0.0 kB/s 2024-05-08T20:58:37.340 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.340 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.340 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00522945 s, 0.0 kB/s 2024-05-08T20:58:37.352 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.352 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.352 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00457572 s, 0.0 kB/s 2024-05-08T20:58:37.365 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.365 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.365 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00508137 s, 0.0 kB/s 2024-05-08T20:58:37.377 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.377 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.377 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00470708 s, 0.0 kB/s 2024-05-08T20:58:37.389 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.389 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.389 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481755 s, 0.0 kB/s 2024-05-08T20:58:37.401 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.402 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.402 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00468601 s, 0.0 kB/s 2024-05-08T20:58:37.414 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.415 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.415 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502113 s, 0.0 kB/s 2024-05-08T20:58:37.427 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.427 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.427 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00456367 s, 0.0 kB/s 2024-05-08T20:58:37.439 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.439 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.439 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048093 s, 0.0 kB/s 2024-05-08T20:58:37.451 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.451 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.451 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00462798 s, 0.0 kB/s 2024-05-08T20:58:37.464 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.464 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.464 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507758 s, 0.0 kB/s 2024-05-08T20:58:37.476 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.476 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.476 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467117 s, 0.0 kB/s 2024-05-08T20:58:37.488 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.488 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.488 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481835 s, 0.0 kB/s 2024-05-08T20:58:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.500 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00462984 s, 0.0 kB/s 2024-05-08T20:58:37.512 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.512 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.512 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490644 s, 0.0 kB/s 2024-05-08T20:58:37.524 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.525 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.525 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00475992 s, 0.0 kB/s 2024-05-08T20:58:37.537 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.537 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.538 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510582 s, 0.0 kB/s 2024-05-08T20:58:37.549 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.549 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.549 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00468225 s, 0.0 kB/s 2024-05-08T20:58:37.561 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:37.562 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:37.562 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488282 s, 0.0 kB/s 2024-05-08T20:58:37.568 INFO:tasks.workunit.client.0.smithi107.stderr:dd: failed to open 'mkfile_test_7f5Gxy/file_101': No space left on device 2024-05-08T20:58:38.832 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:38.832 INFO:tasks.workunit.client.0.smithi107.stderr:+ expect_false make_dirs 101 2024-05-08T20:58:38.832 INFO:tasks.workunit.client.0.smithi107.stderr:+ set -x 2024-05-08T20:58:38.832 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_dirs 101 2024-05-08T20:58:38.832 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:40.127 INFO:tasks.workunit.client.0.smithi107.stderr:mkdir: cannot create directory 'mkdir_test_B1Y8H8/dir_101': No space left on device 2024-05-08T20:58:40.786 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:40.788 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:58:41.387 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:41.388 INFO:tasks.workunit.client.0.smithi107.stderr:+ expect_false make_nodes 101 2024-05-08T20:58:41.388 INFO:tasks.workunit.client.0.smithi107.stderr:+ set -x 2024-05-08T20:58:41.388 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_nodes 101 2024-05-08T20:58:41.388 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:42.610 INFO:tasks.workunit.client.0.smithi107.stderr:mknod: mknod_test_ZiQHDn/fifo_101: No space left on device 2024-05-08T20:58:44.652 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:44.653 INFO:tasks.workunit.client.0.smithi107.stderr:+ expect_false rename_files 101 2024-05-08T20:58:44.653 INFO:tasks.workunit.client.0.smithi107.stderr:+ set -x 2024-05-08T20:58:44.653 INFO:tasks.workunit.client.0.smithi107.stderr:+ rename_files 101 2024-05-08T20:58:44.653 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:46.761 INFO:tasks.workunit.client.0.smithi107.stderr:mv: cannot move 'rename_test_owQcGR/file_101' to 'rename_test_owQcGR/rename/file_101': No space left on device 2024-05-08T20:58:47.578 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:47.579 INFO:tasks.workunit.client.0.smithi107.stderr:+ expect_false make_symlinks 101 2024-05-08T20:58:47.579 INFO:tasks.workunit.client.0.smithi107.stderr:+ set -x 2024-05-08T20:58:47.579 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_symlinks 101 2024-05-08T20:58:47.579 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:48.441 INFO:tasks.workunit.client.0.smithi107.stderr:ln: failed to create symbolic link 'symlink_test_fw2aKV/symlink/sym_101': No space left on device 2024-05-08T20:58:50.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:50.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ expect_false make_links 101 2024-05-08T20:58:50.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ set -x 2024-05-08T20:58:50.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_links 101 2024-05-08T20:58:50.217 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:58:51.989 INFO:tasks.workunit.client.0.smithi107.stderr:ln: failed to create hard link 'link_test_JCSsHj/link/link_101': No space left on device 2024-05-08T20:58:52.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.098+0000 7fa2f7e88700 1 Processor -- start 2024-05-08T20:58:52.105 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.098+0000 7fa2f7e88700 1 -- start start 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f006e3d0 0x7fa2f006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa2f015b180 0x7fa2f013d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f013d550 con 0x7fa2f013f870 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f006d330 con 0x7fa2f015b180 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f006d610 con 0x7fa2f006e3d0 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f6425700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa2f015b180 0x7fa2f013d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f5c24700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa2f013f870 0x7fa2f013fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:41822/0 (socket says 172.21.15.107:41822) 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f5c24700 1 -- 172.21.15.107:0/2271213033 learned_addr learned my addr 172.21.15.107:0/2271213033 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f5423700 1 --2- 172.21.15.107:0/2271213033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f006e3d0 0x7fa2f006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f6425700 1 -- 172.21.15.107:0/2271213033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f006e3d0 msgr2=0x7fa2f006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:58:52.108 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f6425700 1 --2- 172.21.15.107:0/2271213033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f006e3d0 0x7fa2f006cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f6425700 1 -- 172.21.15.107:0/2271213033 >> v1:172.21.15.107:6789/0 conn(0x7fa2f013f870 legacy=0x7fa2f013fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:52.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f6425700 1 -- 172.21.15.107:0/2271213033 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f006d8f0 con 0x7fa2f015b180 2024-05-08T20:58:52.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f4c22700 1 -- 172.21.15.107:0/2271213033 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507146290 0 0) 0x7fa2f013d550 con 0x7fa2f013f870 2024-05-08T20:58:52.109 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f6425700 1 --2- 172.21.15.107:0/2271213033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f015b180 0x7fa2f013d820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800bfa0 tx=0x7fa2e800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0b55cc123193c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f4c22700 1 -- 172.21.15.107:0/2271213033 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8010070 con 0x7fa2f015b180 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f4c22700 1 -- 172.21.15.107:0/2271213033 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800b2e0 con 0x7fa2f015b180 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f4c22700 1 -- 172.21.15.107:0/2271213033 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800dc40 con 0x7fa2f015b180 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- 172.21.15.107:0/2271213033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f015b180 msgr2=0x7fa2f013d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/2271213033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f015b180 0x7fa2f013d820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800bfa0 tx=0x7fa2e800d330 comp rx=0 tx=0).stop 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- 172.21.15.107:0/2271213033 shutdown_connections 2024-05-08T20:58:52.110 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/2271213033 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f015b180 0x7fa2f013d820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/2271213033 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f006e3d0 0x7fa2f006cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- 172.21.15.107:0/2271213033 >> 172.21.15.107:0/2271213033 conn(0x7fa2f00b1290 msgr2=0x7fa2f00b1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:58:52.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- 172.21.15.107:0/2271213033 shutdown_connections 2024-05-08T20:58:52.111 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.102+0000 7fa2f7e88700 1 -- 172.21.15.107:0/2271213033 wait complete. 2024-05-08T20:58:52.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.106+0000 7fa2f7e88700 1 Processor -- start 2024-05-08T20:58:52.112 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.106+0000 7fa2f7e88700 1 -- start start 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.106+0000 7fa2f7e88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 0x7fa2f0158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.106+0000 7fa2f7e88700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f013f870 0x7fa2f015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.106+0000 7fa2f7e88700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f015b180 0x7fa2f0150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f7e88700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0154e50 con 0x7fa2f006e3d0 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f7e88700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f01550f0 con 0x7fa2f015b180 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f7e88700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0159500 con 0x7fa2f013f870 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 0x7fa2f0158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 0x7fa2f0158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38990/0 (socket says 172.21.15.107:38990) 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 -- 172.21.15.107:0/133816135 learned_addr learned my addr 172.21.15.107:0/133816135 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5423700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f013f870 0x7fa2f015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f6425700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f015b180 0x7fa2f0150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:52.115 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 -- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f013f870 msgr2=0x7fa2f015d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:52.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f013f870 0x7fa2f015d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 -- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f015b180 msgr2=0x7fa2f0150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:52.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f015b180 0x7fa2f0150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 -- 172.21.15.107:0/133816135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e800bc80 con 0x7fa2f006e3d0 2024-05-08T20:58:52.116 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f5c24700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 0x7fa2f0158e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c5b0 tx=0x7fa2ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:58:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec004ca0 con 0x7fa2f006e3d0 2024-05-08T20:58:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec004e20 con 0x7fa2f006e3d0 2024-05-08T20:58:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f01597e0 con 0x7fa2f006e3d0 2024-05-08T20:58:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec007310 con 0x7fa2f006e3d0 2024-05-08T20:58:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f015d9c0 con 0x7fa2f006e3d0 2024-05-08T20:58:52.117 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.110+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0159d00 con 0x7fa2f006e3d0 2024-05-08T20:58:52.118 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.114+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2ec007470 con 0x7fa2f006e3d0 2024-05-08T20:58:52.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.114+0000 7fa2e67fc700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa2d4066730 0x7fa2d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:58:52.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.114+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fa2ec083e80 con 0x7fa2f006e3d0 2024-05-08T20:58:52.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.114+0000 7fa2f5423700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa2d4066730 0x7fa2d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:58:52.119 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.114+0000 7fa2f5423700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa2d4066730 0x7fa2d4068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2f015a280 tx=0x7fa2e0009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:58:52.125 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.118+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa2f0159d00 con 0x7fa2f006e3d0 2024-05-08T20:58:52.299 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.294+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7fa2f0159d00 con 0x7fa2f006e3d0 2024-05-08T20:58:52.304 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.298+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v11)=0 v11) v1 ==== 117+0+0 (secure 0 0 0) 0x7fa2f0159d00 con 0x7fa2f006e3d0 2024-05-08T20:58:52.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.398+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mds_dir_max_entries}] v 0) v1 -- 0x7fa2f0159d00 con 0x7fa2f006e3d0 2024-05-08T20:58:52.404 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.398+0000 7fa2e67fc700 1 -- 172.21.15.107:0/133816135 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_dir_max_entries}]=0 v11)=0 v11) v1 ==== 117+0+0 (secure 0 0 0) 0x7fa2f0159d00 con 0x7fa2f006e3d0 2024-05-08T20:58:52.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa2d4066730 msgr2=0x7fa2d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:52.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa2d4066730 0x7fa2d4068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2f015a280 tx=0x7fa2e0009240 comp rx=0 tx=0).stop 2024-05-08T20:58:52.407 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 msgr2=0x7fa2f0158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 0x7fa2f0158e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c5b0 tx=0x7fa2ec00c8c0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 shutdown_connections 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2f015b180 0x7fa2f0150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa2d4066730 0x7fa2d4068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa2f013f870 0x7fa2f015d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 --2- 172.21.15.107:0/133816135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa2f006e3d0 0x7fa2f0158e20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 >> 172.21.15.107:0/133816135 conn(0x7fa2f00b1290 msgr2=0x7fa2f013fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 shutdown_connections 2024-05-08T20:58:52.408 INFO:tasks.workunit.client.0.smithi107.stderr:2024-05-08T20:58:52.402+0000 7fa2f7e88700 1 -- 172.21.15.107:0/133816135 wait complete. 2024-05-08T20:58:52.482 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.483 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.483 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0519789 s, 0.0 kB/s 2024-05-08T20:58:52.493 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.493 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.493 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00422287 s, 0.0 kB/s 2024-05-08T20:58:52.504 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.504 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.504 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00397421 s, 0.0 kB/s 2024-05-08T20:58:52.515 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.515 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.516 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00468186 s, 0.0 kB/s 2024-05-08T20:58:52.527 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.527 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.527 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466587 s, 0.0 kB/s 2024-05-08T20:58:52.539 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.539 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.539 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00476527 s, 0.0 kB/s 2024-05-08T20:58:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.551 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481857 s, 0.0 kB/s 2024-05-08T20:58:52.564 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.564 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.564 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00509117 s, 0.0 kB/s 2024-05-08T20:58:52.576 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.576 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.576 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00489658 s, 0.0 kB/s 2024-05-08T20:58:52.589 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.589 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.589 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00546607 s, 0.0 kB/s 2024-05-08T20:58:52.602 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.602 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.602 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494689 s, 0.0 kB/s 2024-05-08T20:58:52.615 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.615 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.615 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00498666 s, 0.0 kB/s 2024-05-08T20:58:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.627 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00455104 s, 0.0 kB/s 2024-05-08T20:58:52.639 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.639 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.639 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488464 s, 0.0 kB/s 2024-05-08T20:58:52.652 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.652 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.652 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506967 s, 0.0 kB/s 2024-05-08T20:58:52.665 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.665 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.665 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497974 s, 0.0 kB/s 2024-05-08T20:58:52.677 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.677 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.677 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483571 s, 0.0 kB/s 2024-05-08T20:58:52.690 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.690 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.690 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511577 s, 0.0 kB/s 2024-05-08T20:58:52.703 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.703 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.703 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00533839 s, 0.0 kB/s 2024-05-08T20:58:52.716 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.716 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.716 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052132 s, 0.0 kB/s 2024-05-08T20:58:52.728 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.728 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.728 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490325 s, 0.0 kB/s 2024-05-08T20:58:52.741 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.741 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.741 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501063 s, 0.0 kB/s 2024-05-08T20:58:52.754 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.754 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.754 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505676 s, 0.0 kB/s 2024-05-08T20:58:52.767 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.767 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.767 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00484987 s, 0.0 kB/s 2024-05-08T20:58:52.779 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.779 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.779 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525747 s, 0.0 kB/s 2024-05-08T20:58:52.792 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.792 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.792 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00550238 s, 0.0 kB/s 2024-05-08T20:58:52.805 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.805 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.805 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512401 s, 0.0 kB/s 2024-05-08T20:58:52.818 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.818 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.818 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00519863 s, 0.0 kB/s 2024-05-08T20:58:52.830 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.830 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.830 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00503403 s, 0.0 kB/s 2024-05-08T20:58:52.843 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.843 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.843 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00489536 s, 0.0 kB/s 2024-05-08T20:58:52.856 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.856 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.856 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00516423 s, 0.0 kB/s 2024-05-08T20:58:52.868 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.869 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.869 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00489351 s, 0.0 kB/s 2024-05-08T20:58:52.881 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.882 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.882 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00542009 s, 0.0 kB/s 2024-05-08T20:58:52.894 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.894 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.894 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490083 s, 0.0 kB/s 2024-05-08T20:58:52.907 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.907 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.908 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00557867 s, 0.0 kB/s 2024-05-08T20:58:52.920 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.920 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.920 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488843 s, 0.0 kB/s 2024-05-08T20:58:52.932 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.933 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.933 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00519823 s, 0.0 kB/s 2024-05-08T20:58:52.945 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.945 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.945 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00446009 s, 0.0 kB/s 2024-05-08T20:58:52.957 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.958 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.958 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496543 s, 0.0 kB/s 2024-05-08T20:58:52.970 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.970 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.970 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046612 s, 0.0 kB/s 2024-05-08T20:58:52.983 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.983 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.983 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512709 s, 0.0 kB/s 2024-05-08T20:58:52.995 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:52.995 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:52.995 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00514609 s, 0.0 kB/s 2024-05-08T20:58:53.008 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.008 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.008 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00539235 s, 0.0 kB/s 2024-05-08T20:58:53.021 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.021 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.021 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00472394 s, 0.0 kB/s 2024-05-08T20:58:53.033 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.034 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.034 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.005103 s, 0.0 kB/s 2024-05-08T20:58:53.046 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.046 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.046 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00504357 s, 0.0 kB/s 2024-05-08T20:58:53.059 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.059 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.059 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00573944 s, 0.0 kB/s 2024-05-08T20:58:53.072 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.072 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.072 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00498823 s, 0.0 kB/s 2024-05-08T20:58:53.086 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.086 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.086 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00612175 s, 0.0 kB/s 2024-05-08T20:58:53.100 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.100 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.100 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00623323 s, 0.0 kB/s 2024-05-08T20:58:53.112 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.112 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.112 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048107 s, 0.0 kB/s 2024-05-08T20:58:53.125 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.125 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.125 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515627 s, 0.0 kB/s 2024-05-08T20:58:53.137 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.137 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.137 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00470254 s, 0.0 kB/s 2024-05-08T20:58:53.149 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.150 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.150 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047457 s, 0.0 kB/s 2024-05-08T20:58:53.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.162 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00457121 s, 0.0 kB/s 2024-05-08T20:58:53.174 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.174 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.174 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00454672 s, 0.0 kB/s 2024-05-08T20:58:53.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.187 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.187 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00444638 s, 0.0 kB/s 2024-05-08T20:58:53.199 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.199 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.199 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00491089 s, 0.0 kB/s 2024-05-08T20:58:53.211 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.211 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.211 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00459792 s, 0.0 kB/s 2024-05-08T20:58:53.223 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.224 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.224 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00463107 s, 0.0 kB/s 2024-05-08T20:58:53.236 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.236 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.236 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00485082 s, 0.0 kB/s 2024-05-08T20:58:53.249 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.249 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.249 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00526319 s, 0.0 kB/s 2024-05-08T20:58:53.261 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.261 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.261 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483761 s, 0.0 kB/s 2024-05-08T20:58:53.276 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.276 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.277 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00570589 s, 0.0 kB/s 2024-05-08T20:58:53.289 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.289 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.289 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00482768 s, 0.0 kB/s 2024-05-08T20:58:53.302 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.302 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.302 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0049371 s, 0.0 kB/s 2024-05-08T20:58:53.315 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.315 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.315 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480927 s, 0.0 kB/s 2024-05-08T20:58:53.326 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.326 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.326 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00430491 s, 0.0 kB/s 2024-05-08T20:58:53.337 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.337 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.337 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00450402 s, 0.0 kB/s 2024-05-08T20:58:53.349 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.350 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.350 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494247 s, 0.0 kB/s 2024-05-08T20:58:53.362 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.362 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.362 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00524731 s, 0.0 kB/s 2024-05-08T20:58:53.374 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.374 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.374 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00453095 s, 0.0 kB/s 2024-05-08T20:58:53.387 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.387 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.387 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00491262 s, 0.0 kB/s 2024-05-08T20:58:53.400 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.400 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.400 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00540754 s, 0.0 kB/s 2024-05-08T20:58:53.412 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.413 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.413 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00463463 s, 0.0 kB/s 2024-05-08T20:58:53.425 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.425 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.425 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505257 s, 0.0 kB/s 2024-05-08T20:58:53.440 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.440 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.440 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00589961 s, 0.0 kB/s 2024-05-08T20:58:53.453 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.453 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.453 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00531424 s, 0.0 kB/s 2024-05-08T20:58:53.465 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.465 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.465 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00456908 s, 0.0 kB/s 2024-05-08T20:58:53.478 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.478 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.478 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512255 s, 0.0 kB/s 2024-05-08T20:58:53.490 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.490 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.490 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502188 s, 0.0 kB/s 2024-05-08T20:58:53.503 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.504 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.504 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00540719 s, 0.0 kB/s 2024-05-08T20:58:53.516 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.516 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.516 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047993 s, 0.0 kB/s 2024-05-08T20:58:53.529 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.529 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.530 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00509018 s, 0.0 kB/s 2024-05-08T20:58:53.541 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.542 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.542 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507702 s, 0.0 kB/s 2024-05-08T20:58:53.555 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.555 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.555 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00528204 s, 0.0 kB/s 2024-05-08T20:58:53.568 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.568 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.568 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050716 s, 0.0 kB/s 2024-05-08T20:58:53.581 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.581 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.581 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505414 s, 0.0 kB/s 2024-05-08T20:58:53.594 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.594 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.594 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00543011 s, 0.0 kB/s 2024-05-08T20:58:53.606 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.606 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.606 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466456 s, 0.0 kB/s 2024-05-08T20:58:53.618 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.618 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.618 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512075 s, 0.0 kB/s 2024-05-08T20:58:53.630 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.630 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.630 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00485541 s, 0.0 kB/s 2024-05-08T20:58:53.643 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.643 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.643 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517448 s, 0.0 kB/s 2024-05-08T20:58:53.656 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.656 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.656 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00536738 s, 0.0 kB/s 2024-05-08T20:58:53.670 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.670 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.670 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00559483 s, 0.0 kB/s 2024-05-08T20:58:53.683 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.683 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.683 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497585 s, 0.0 kB/s 2024-05-08T20:58:53.696 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.696 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.696 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00543054 s, 0.0 kB/s 2024-05-08T20:58:53.709 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.709 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.709 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500669 s, 0.0 kB/s 2024-05-08T20:58:53.721 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.721 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.722 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481828 s, 0.0 kB/s 2024-05-08T20:58:53.734 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.734 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.734 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494191 s, 0.0 kB/s 2024-05-08T20:58:53.747 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.748 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.748 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00548295 s, 0.0 kB/s 2024-05-08T20:58:53.760 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.760 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.760 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486118 s, 0.0 kB/s 2024-05-08T20:58:53.772 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.773 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.773 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515603 s, 0.0 kB/s 2024-05-08T20:58:53.785 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.785 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.785 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496006 s, 0.0 kB/s 2024-05-08T20:58:53.798 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.798 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.798 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00518381 s, 0.0 kB/s 2024-05-08T20:58:53.811 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.811 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.811 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505184 s, 0.0 kB/s 2024-05-08T20:58:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.824 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505312 s, 0.0 kB/s 2024-05-08T20:58:53.836 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.836 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.836 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500606 s, 0.0 kB/s 2024-05-08T20:58:53.849 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.849 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.849 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0049577 s, 0.0 kB/s 2024-05-08T20:58:53.860 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.860 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.861 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0045318 s, 0.0 kB/s 2024-05-08T20:58:53.873 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.874 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.874 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00538564 s, 0.0 kB/s 2024-05-08T20:58:53.886 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.886 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.886 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00476191 s, 0.0 kB/s 2024-05-08T20:58:53.898 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.899 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.899 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488075 s, 0.0 kB/s 2024-05-08T20:58:53.911 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.911 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.911 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473074 s, 0.0 kB/s 2024-05-08T20:58:53.923 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.923 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.923 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00479475 s, 0.0 kB/s 2024-05-08T20:58:53.936 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.936 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.936 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497412 s, 0.0 kB/s 2024-05-08T20:58:53.948 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.948 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.948 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00475344 s, 0.0 kB/s 2024-05-08T20:58:53.961 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.961 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.961 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507928 s, 0.0 kB/s 2024-05-08T20:58:53.974 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.974 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.974 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00487124 s, 0.0 kB/s 2024-05-08T20:58:53.986 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.986 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.986 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502244 s, 0.0 kB/s 2024-05-08T20:58:53.998 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:53.998 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:53.998 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00458237 s, 0.0 kB/s 2024-05-08T20:58:54.011 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.011 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.011 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00491706 s, 0.0 kB/s 2024-05-08T20:58:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.023 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00461853 s, 0.0 kB/s 2024-05-08T20:58:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.036 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501254 s, 0.0 kB/s 2024-05-08T20:58:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.049 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00476294 s, 0.0 kB/s 2024-05-08T20:58:54.062 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.062 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.062 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506566 s, 0.0 kB/s 2024-05-08T20:58:54.074 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.074 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.074 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478907 s, 0.0 kB/s 2024-05-08T20:58:54.087 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.087 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.087 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478948 s, 0.0 kB/s 2024-05-08T20:58:54.099 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.099 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.099 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00476509 s, 0.0 kB/s 2024-05-08T20:58:54.111 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.112 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.112 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00492971 s, 0.0 kB/s 2024-05-08T20:58:54.124 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.124 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.124 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00474159 s, 0.0 kB/s 2024-05-08T20:58:54.137 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.137 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.137 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488826 s, 0.0 kB/s 2024-05-08T20:58:54.149 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.149 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.150 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480091 s, 0.0 kB/s 2024-05-08T20:58:54.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.162 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.162 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493623 s, 0.0 kB/s 2024-05-08T20:58:54.174 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.175 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.175 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00470337 s, 0.0 kB/s 2024-05-08T20:58:54.187 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.187 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.187 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510297 s, 0.0 kB/s 2024-05-08T20:58:54.199 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.199 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.199 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00446658 s, 0.0 kB/s 2024-05-08T20:58:54.212 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.212 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.212 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483728 s, 0.0 kB/s 2024-05-08T20:58:54.223 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.224 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.224 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00444655 s, 0.0 kB/s 2024-05-08T20:58:54.235 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.235 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.235 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505434 s, 0.0 kB/s 2024-05-08T20:58:54.248 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.248 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.248 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00489228 s, 0.0 kB/s 2024-05-08T20:58:54.260 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.260 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.260 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00492568 s, 0.0 kB/s 2024-05-08T20:58:54.273 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.273 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.273 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500662 s, 0.0 kB/s 2024-05-08T20:58:54.285 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.285 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.285 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00444418 s, 0.0 kB/s 2024-05-08T20:58:54.297 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.297 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.297 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502908 s, 0.0 kB/s 2024-05-08T20:58:54.309 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.309 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.309 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490121 s, 0.0 kB/s 2024-05-08T20:58:54.323 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.323 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.323 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478244 s, 0.0 kB/s 2024-05-08T20:58:54.334 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.334 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.334 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00437793 s, 0.0 kB/s 2024-05-08T20:58:54.344 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.345 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.345 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00442789 s, 0.0 kB/s 2024-05-08T20:58:54.359 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.359 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.359 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00454634 s, 0.0 kB/s 2024-05-08T20:58:54.368 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.368 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.368 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00485082 s, 0.0 kB/s 2024-05-08T20:58:54.379 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.379 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.379 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00441298 s, 0.0 kB/s 2024-05-08T20:58:54.392 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.392 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.392 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510306 s, 0.0 kB/s 2024-05-08T20:58:54.404 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.404 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.404 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483421 s, 0.0 kB/s 2024-05-08T20:58:54.417 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.417 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.417 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00526036 s, 0.0 kB/s 2024-05-08T20:58:54.429 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.429 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.429 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00523181 s, 0.0 kB/s 2024-05-08T20:58:54.443 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.443 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.443 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00560491 s, 0.0 kB/s 2024-05-08T20:58:54.456 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.456 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.456 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00530032 s, 0.0 kB/s 2024-05-08T20:58:54.468 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.468 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.468 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00499795 s, 0.0 kB/s 2024-05-08T20:58:54.481 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.481 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.482 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0053477 s, 0.0 kB/s 2024-05-08T20:58:54.493 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.493 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.493 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00469689 s, 0.0 kB/s 2024-05-08T20:58:54.506 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.506 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.506 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.004823 s, 0.0 kB/s 2024-05-08T20:58:54.518 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.518 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.518 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467725 s, 0.0 kB/s 2024-05-08T20:58:54.529 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.530 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.530 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00471505 s, 0.0 kB/s 2024-05-08T20:58:54.542 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.542 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.542 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481178 s, 0.0 kB/s 2024-05-08T20:58:54.554 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.554 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.554 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505102 s, 0.0 kB/s 2024-05-08T20:58:54.567 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.567 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.567 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466216 s, 0.0 kB/s 2024-05-08T20:58:54.579 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.579 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.579 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506225 s, 0.0 kB/s 2024-05-08T20:58:54.592 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.592 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.592 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494062 s, 0.0 kB/s 2024-05-08T20:58:54.604 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.605 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.605 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.005074 s, 0.0 kB/s 2024-05-08T20:58:54.617 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.617 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.618 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050173 s, 0.0 kB/s 2024-05-08T20:58:54.630 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.630 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.630 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513214 s, 0.0 kB/s 2024-05-08T20:58:54.643 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.643 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.643 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00482237 s, 0.0 kB/s 2024-05-08T20:58:54.656 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.656 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.656 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496777 s, 0.0 kB/s 2024-05-08T20:58:54.668 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.668 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.669 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493042 s, 0.0 kB/s 2024-05-08T20:58:54.681 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.682 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.682 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506652 s, 0.0 kB/s 2024-05-08T20:58:54.694 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.694 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.694 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00457611 s, 0.0 kB/s 2024-05-08T20:58:54.707 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.707 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.707 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510605 s, 0.0 kB/s 2024-05-08T20:58:54.719 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.720 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.720 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00463521 s, 0.0 kB/s 2024-05-08T20:58:54.733 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.733 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.733 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00545394 s, 0.0 kB/s 2024-05-08T20:58:54.745 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.746 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.746 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00499842 s, 0.0 kB/s 2024-05-08T20:58:54.758 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.759 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.759 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00534342 s, 0.0 kB/s 2024-05-08T20:58:54.771 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.771 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.771 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050687 s, 0.0 kB/s 2024-05-08T20:58:54.784 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.785 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.785 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00536603 s, 0.0 kB/s 2024-05-08T20:58:54.797 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.798 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.798 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00487133 s, 0.0 kB/s 2024-05-08T20:58:54.810 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.811 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.811 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520149 s, 0.0 kB/s 2024-05-08T20:58:54.823 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.824 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.824 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00535375 s, 0.0 kB/s 2024-05-08T20:58:54.836 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.837 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.837 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507891 s, 0.0 kB/s 2024-05-08T20:58:54.850 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.850 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.850 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00539452 s, 0.0 kB/s 2024-05-08T20:58:54.862 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.862 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.863 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00499344 s, 0.0 kB/s 2024-05-08T20:58:54.875 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.875 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.876 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0053605 s, 0.0 kB/s 2024-05-08T20:58:54.888 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.888 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.888 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00533038 s, 0.0 kB/s 2024-05-08T20:58:54.901 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.902 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.902 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511677 s, 0.0 kB/s 2024-05-08T20:58:54.914 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.914 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.914 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00472727 s, 0.0 kB/s 2024-05-08T20:58:54.926 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.926 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.927 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00527622 s, 0.0 kB/s 2024-05-08T20:58:54.938 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.938 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.938 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050678 s, 0.0 kB/s 2024-05-08T20:58:54.951 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.951 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.951 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525026 s, 0.0 kB/s 2024-05-08T20:58:54.964 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.964 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.964 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00508699 s, 0.0 kB/s 2024-05-08T20:58:54.977 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.977 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.977 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00521907 s, 0.0 kB/s 2024-05-08T20:58:54.990 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:54.990 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:54.990 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494403 s, 0.0 kB/s 2024-05-08T20:58:55.003 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.003 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.003 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00519251 s, 0.0 kB/s 2024-05-08T20:58:55.016 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.016 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.016 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501119 s, 0.0 kB/s 2024-05-08T20:58:55.029 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.029 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.029 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00516541 s, 0.0 kB/s 2024-05-08T20:58:55.041 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.042 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.042 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497265 s, 0.0 kB/s 2024-05-08T20:58:55.054 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.054 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.054 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00509076 s, 0.0 kB/s 2024-05-08T20:58:55.066 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.066 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.067 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00464878 s, 0.0 kB/s 2024-05-08T20:58:55.079 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.079 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.079 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494911 s, 0.0 kB/s 2024-05-08T20:58:55.092 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.092 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.092 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483225 s, 0.0 kB/s 2024-05-08T20:58:55.105 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.105 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.105 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513639 s, 0.0 kB/s 2024-05-08T20:58:55.117 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.117 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.117 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00471264 s, 0.0 kB/s 2024-05-08T20:58:55.130 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.130 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.130 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520204 s, 0.0 kB/s 2024-05-08T20:58:55.143 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.143 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.143 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505544 s, 0.0 kB/s 2024-05-08T20:58:55.156 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.156 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.156 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511541 s, 0.0 kB/s 2024-05-08T20:58:55.168 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.169 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.169 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0053635 s, 0.0 kB/s 2024-05-08T20:58:55.181 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.181 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.181 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00489356 s, 0.0 kB/s 2024-05-08T20:58:55.194 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.194 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.194 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00528633 s, 0.0 kB/s 2024-05-08T20:58:55.206 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.206 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.206 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048842 s, 0.0 kB/s 2024-05-08T20:58:55.220 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.220 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.220 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512314 s, 0.0 kB/s 2024-05-08T20:58:55.232 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.233 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.233 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467607 s, 0.0 kB/s 2024-05-08T20:58:55.246 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.247 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.247 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525965 s, 0.0 kB/s 2024-05-08T20:58:55.260 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.260 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.261 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00535113 s, 0.0 kB/s 2024-05-08T20:58:55.276 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.276 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.276 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510301 s, 0.0 kB/s 2024-05-08T20:58:55.290 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.290 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.290 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490924 s, 0.0 kB/s 2024-05-08T20:58:55.303 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.303 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.304 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048422 s, 0.0 kB/s 2024-05-08T20:58:55.316 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.316 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.316 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047637 s, 0.0 kB/s 2024-05-08T20:58:55.329 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.329 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.329 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00428634 s, 0.0 kB/s 2024-05-08T20:58:55.342 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.343 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.343 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00450741 s, 0.0 kB/s 2024-05-08T20:58:55.355 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.355 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.355 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00471111 s, 0.0 kB/s 2024-05-08T20:58:55.368 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.369 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.369 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00475057 s, 0.0 kB/s 2024-05-08T20:58:55.381 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.381 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.381 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00360113 s, 0.0 kB/s 2024-05-08T20:58:55.390 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.390 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.390 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00371044 s, 0.0 kB/s 2024-05-08T20:58:55.400 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.400 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.400 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0042822 s, 0.0 kB/s 2024-05-08T20:58:55.411 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.412 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.412 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0044456 s, 0.0 kB/s 2024-05-08T20:58:55.423 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.424 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.424 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480954 s, 0.0 kB/s 2024-05-08T20:58:55.436 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.437 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.437 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00539599 s, 0.0 kB/s 2024-05-08T20:58:55.450 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.450 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.450 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00551828 s, 0.0 kB/s 2024-05-08T20:58:55.462 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.462 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.463 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520125 s, 0.0 kB/s 2024-05-08T20:58:55.475 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.476 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.476 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00551459 s, 0.0 kB/s 2024-05-08T20:58:55.489 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.489 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.489 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506655 s, 0.0 kB/s 2024-05-08T20:58:55.501 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.501 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.501 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050168 s, 0.0 kB/s 2024-05-08T20:58:55.514 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.514 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.514 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00479153 s, 0.0 kB/s 2024-05-08T20:58:55.526 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.527 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.527 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483256 s, 0.0 kB/s 2024-05-08T20:58:55.539 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.539 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.539 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047808 s, 0.0 kB/s 2024-05-08T20:58:55.551 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.551 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.551 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496871 s, 0.0 kB/s 2024-05-08T20:58:55.564 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.564 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.564 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046969 s, 0.0 kB/s 2024-05-08T20:58:55.576 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.576 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.576 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0048192 s, 0.0 kB/s 2024-05-08T20:58:55.589 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.589 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.589 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466473 s, 0.0 kB/s 2024-05-08T20:58:55.601 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.601 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.601 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500561 s, 0.0 kB/s 2024-05-08T20:58:55.613 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.613 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.613 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00472499 s, 0.0 kB/s 2024-05-08T20:58:55.626 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.626 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.626 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00482009 s, 0.0 kB/s 2024-05-08T20:58:55.638 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.638 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.638 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00482695 s, 0.0 kB/s 2024-05-08T20:58:55.651 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.651 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.651 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00533154 s, 0.0 kB/s 2024-05-08T20:58:55.664 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.664 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.664 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515353 s, 0.0 kB/s 2024-05-08T20:58:55.676 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.677 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.677 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00498536 s, 0.0 kB/s 2024-05-08T20:58:55.689 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.689 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.689 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00521788 s, 0.0 kB/s 2024-05-08T20:58:55.702 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.702 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.702 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495278 s, 0.0 kB/s 2024-05-08T20:58:55.715 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.715 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.715 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052081 s, 0.0 kB/s 2024-05-08T20:58:55.727 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.727 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.727 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00468841 s, 0.0 kB/s 2024-05-08T20:58:55.740 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.740 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.740 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502296 s, 0.0 kB/s 2024-05-08T20:58:55.752 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.753 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.753 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473525 s, 0.0 kB/s 2024-05-08T20:58:55.765 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.766 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.766 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517127 s, 0.0 kB/s 2024-05-08T20:58:55.778 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.778 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.778 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486571 s, 0.0 kB/s 2024-05-08T20:58:55.791 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.791 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.791 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00519808 s, 0.0 kB/s 2024-05-08T20:58:55.804 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.804 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.804 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501736 s, 0.0 kB/s 2024-05-08T20:58:55.816 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.816 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.816 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00499139 s, 0.0 kB/s 2024-05-08T20:58:55.828 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.829 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.829 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497925 s, 0.0 kB/s 2024-05-08T20:58:55.841 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.842 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.842 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00538763 s, 0.0 kB/s 2024-05-08T20:58:55.854 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.854 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.854 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513482 s, 0.0 kB/s 2024-05-08T20:58:55.867 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.867 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.868 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00539621 s, 0.0 kB/s 2024-05-08T20:58:55.880 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.880 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.880 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00521749 s, 0.0 kB/s 2024-05-08T20:58:55.894 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.894 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.894 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00578362 s, 0.0 kB/s 2024-05-08T20:58:55.906 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.907 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.907 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502386 s, 0.0 kB/s 2024-05-08T20:58:55.920 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.920 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.920 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00527193 s, 0.0 kB/s 2024-05-08T20:58:55.932 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.933 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.933 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050737 s, 0.0 kB/s 2024-05-08T20:58:55.945 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.945 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.945 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00519561 s, 0.0 kB/s 2024-05-08T20:58:55.958 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.959 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.959 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00536874 s, 0.0 kB/s 2024-05-08T20:58:55.971 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.972 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.972 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00564397 s, 0.0 kB/s 2024-05-08T20:58:55.984 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.984 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.984 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00492645 s, 0.0 kB/s 2024-05-08T20:58:55.997 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:55.997 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:55.997 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00530932 s, 0.0 kB/s 2024-05-08T20:58:56.010 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.010 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.010 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497294 s, 0.0 kB/s 2024-05-08T20:58:56.022 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.022 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.022 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00452439 s, 0.0 kB/s 2024-05-08T20:58:56.035 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.035 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.035 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483735 s, 0.0 kB/s 2024-05-08T20:58:56.046 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.046 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.046 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00471444 s, 0.0 kB/s 2024-05-08T20:58:56.059 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.059 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.059 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00531713 s, 0.0 kB/s 2024-05-08T20:58:56.071 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.072 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.072 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507115 s, 0.0 kB/s 2024-05-08T20:58:56.084 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.084 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.085 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00519696 s, 0.0 kB/s 2024-05-08T20:58:56.097 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.097 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.097 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00469675 s, 0.0 kB/s 2024-05-08T20:58:56.110 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.110 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.110 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515264 s, 0.0 kB/s 2024-05-08T20:58:56.123 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.123 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.123 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480103 s, 0.0 kB/s 2024-05-08T20:58:56.136 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.136 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.136 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00530186 s, 0.0 kB/s 2024-05-08T20:58:56.148 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.148 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.148 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00461035 s, 0.0 kB/s 2024-05-08T20:58:56.161 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.161 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.161 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515433 s, 0.0 kB/s 2024-05-08T20:58:56.174 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.174 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.174 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050601 s, 0.0 kB/s 2024-05-08T20:58:56.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.187 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511718 s, 0.0 kB/s 2024-05-08T20:58:56.199 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.199 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.199 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00484925 s, 0.0 kB/s 2024-05-08T20:58:56.211 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.212 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.212 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520223 s, 0.0 kB/s 2024-05-08T20:58:56.225 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.225 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.225 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00529358 s, 0.0 kB/s 2024-05-08T20:58:56.238 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.238 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.239 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00594332 s, 0.0 kB/s 2024-05-08T20:58:56.252 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.252 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.252 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00544847 s, 0.0 kB/s 2024-05-08T20:58:56.264 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.264 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.265 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494365 s, 0.0 kB/s 2024-05-08T20:58:56.279 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.279 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.279 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00522647 s, 0.0 kB/s 2024-05-08T20:58:56.292 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.293 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.293 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00564614 s, 0.0 kB/s 2024-05-08T20:58:56.306 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.306 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.306 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500796 s, 0.0 kB/s 2024-05-08T20:58:56.319 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.319 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.319 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00545652 s, 0.0 kB/s 2024-05-08T20:58:56.331 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.331 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.331 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00423162 s, 0.0 kB/s 2024-05-08T20:58:56.342 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.343 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.343 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00484376 s, 0.0 kB/s 2024-05-08T20:58:56.355 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.355 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.355 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00508249 s, 0.0 kB/s 2024-05-08T20:58:56.367 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.367 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.368 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510448 s, 0.0 kB/s 2024-05-08T20:58:56.381 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.381 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.381 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502869 s, 0.0 kB/s 2024-05-08T20:58:56.395 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.395 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.395 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00574669 s, 0.0 kB/s 2024-05-08T20:58:56.409 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.409 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.409 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00543738 s, 0.0 kB/s 2024-05-08T20:58:56.421 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.422 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.422 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517126 s, 0.0 kB/s 2024-05-08T20:58:56.434 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.434 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.434 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00536149 s, 0.0 kB/s 2024-05-08T20:58:56.447 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.448 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.448 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510074 s, 0.0 kB/s 2024-05-08T20:58:56.460 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.460 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.460 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517329 s, 0.0 kB/s 2024-05-08T20:58:56.472 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.473 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.473 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493607 s, 0.0 kB/s 2024-05-08T20:58:56.485 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.485 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.485 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052736 s, 0.0 kB/s 2024-05-08T20:58:56.498 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.498 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.498 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488297 s, 0.0 kB/s 2024-05-08T20:58:56.510 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.511 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.511 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512896 s, 0.0 kB/s 2024-05-08T20:58:56.523 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.523 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.523 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488275 s, 0.0 kB/s 2024-05-08T20:58:56.536 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.536 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.536 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00551868 s, 0.0 kB/s 2024-05-08T20:58:56.548 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.548 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.548 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00469754 s, 0.0 kB/s 2024-05-08T20:58:56.561 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.561 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.561 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00532393 s, 0.0 kB/s 2024-05-08T20:58:56.574 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.574 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.574 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511971 s, 0.0 kB/s 2024-05-08T20:58:56.587 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.587 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.587 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0050821 s, 0.0 kB/s 2024-05-08T20:58:56.600 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.600 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.600 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520897 s, 0.0 kB/s 2024-05-08T20:58:56.612 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.612 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.612 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496281 s, 0.0 kB/s 2024-05-08T20:58:56.624 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.624 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.624 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00514017 s, 0.0 kB/s 2024-05-08T20:58:56.637 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.637 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.637 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00465376 s, 0.0 kB/s 2024-05-08T20:58:56.650 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.650 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.650 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525155 s, 0.0 kB/s 2024-05-08T20:58:56.663 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.663 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.663 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511884 s, 0.0 kB/s 2024-05-08T20:58:56.676 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.676 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.676 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00508309 s, 0.0 kB/s 2024-05-08T20:58:56.689 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.689 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.689 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00503074 s, 0.0 kB/s 2024-05-08T20:58:56.702 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.702 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.702 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00523332 s, 0.0 kB/s 2024-05-08T20:58:56.714 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.714 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.714 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480931 s, 0.0 kB/s 2024-05-08T20:58:56.727 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.727 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.727 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493422 s, 0.0 kB/s 2024-05-08T20:58:56.739 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.740 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.740 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0047121 s, 0.0 kB/s 2024-05-08T20:58:56.752 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.752 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.752 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00553227 s, 0.0 kB/s 2024-05-08T20:58:56.765 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.765 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.765 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506088 s, 0.0 kB/s 2024-05-08T20:58:56.778 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.778 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.778 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490902 s, 0.0 kB/s 2024-05-08T20:58:56.791 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.791 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.791 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00536104 s, 0.0 kB/s 2024-05-08T20:58:56.803 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.803 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.804 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483326 s, 0.0 kB/s 2024-05-08T20:58:56.816 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.816 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.816 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501031 s, 0.0 kB/s 2024-05-08T20:58:56.828 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.828 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.828 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500648 s, 0.0 kB/s 2024-05-08T20:58:56.841 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.841 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.841 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486681 s, 0.0 kB/s 2024-05-08T20:58:56.854 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.854 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.854 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00537468 s, 0.0 kB/s 2024-05-08T20:58:56.866 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.866 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.866 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00477454 s, 0.0 kB/s 2024-05-08T20:58:56.879 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.880 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.880 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493695 s, 0.0 kB/s 2024-05-08T20:58:56.892 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.892 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.892 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00518359 s, 0.0 kB/s 2024-05-08T20:58:56.905 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.905 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.905 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00526777 s, 0.0 kB/s 2024-05-08T20:58:56.918 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.918 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.918 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00555452 s, 0.0 kB/s 2024-05-08T20:58:56.931 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.931 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.931 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501681 s, 0.0 kB/s 2024-05-08T20:58:56.944 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.944 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.944 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00546877 s, 0.0 kB/s 2024-05-08T20:58:56.957 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.957 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.957 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00521163 s, 0.0 kB/s 2024-05-08T20:58:56.970 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.970 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.970 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507901 s, 0.0 kB/s 2024-05-08T20:58:56.982 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.982 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.982 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493536 s, 0.0 kB/s 2024-05-08T20:58:56.995 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:56.995 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:56.995 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00533304 s, 0.0 kB/s 2024-05-08T20:58:57.008 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.008 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.008 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052377 s, 0.0 kB/s 2024-05-08T20:58:57.021 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.021 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.021 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00515477 s, 0.0 kB/s 2024-05-08T20:58:57.033 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.033 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.033 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483826 s, 0.0 kB/s 2024-05-08T20:58:57.046 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.046 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.047 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00548649 s, 0.0 kB/s 2024-05-08T20:58:57.059 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.059 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.060 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494989 s, 0.0 kB/s 2024-05-08T20:58:57.073 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.073 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.074 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00518028 s, 0.0 kB/s 2024-05-08T20:58:57.087 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.087 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.087 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502181 s, 0.0 kB/s 2024-05-08T20:58:57.101 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.101 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.101 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00531807 s, 0.0 kB/s 2024-05-08T20:58:57.114 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.114 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.114 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490974 s, 0.0 kB/s 2024-05-08T20:58:57.128 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.128 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.128 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00522783 s, 0.0 kB/s 2024-05-08T20:58:57.141 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.141 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.141 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00466217 s, 0.0 kB/s 2024-05-08T20:58:57.154 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.154 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.154 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00509393 s, 0.0 kB/s 2024-05-08T20:58:57.167 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.167 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.167 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495269 s, 0.0 kB/s 2024-05-08T20:58:57.180 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.180 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.180 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495793 s, 0.0 kB/s 2024-05-08T20:58:57.194 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.194 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.194 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052118 s, 0.0 kB/s 2024-05-08T20:58:57.208 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.208 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.208 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00548759 s, 0.0 kB/s 2024-05-08T20:58:57.221 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.221 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.221 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494235 s, 0.0 kB/s 2024-05-08T20:58:57.234 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.234 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.234 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501755 s, 0.0 kB/s 2024-05-08T20:58:57.247 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.248 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.248 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497105 s, 0.0 kB/s 2024-05-08T20:58:57.261 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.261 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.261 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00487521 s, 0.0 kB/s 2024-05-08T20:58:57.276 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.276 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.276 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00514966 s, 0.0 kB/s 2024-05-08T20:58:57.289 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.289 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.289 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00478639 s, 0.0 kB/s 2024-05-08T20:58:57.302 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.302 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.303 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520383 s, 0.0 kB/s 2024-05-08T20:58:57.316 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.316 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.316 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00499215 s, 0.0 kB/s 2024-05-08T20:58:57.329 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.329 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.329 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488605 s, 0.0 kB/s 2024-05-08T20:58:57.342 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.342 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.342 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00468181 s, 0.0 kB/s 2024-05-08T20:58:57.355 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.356 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.356 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506029 s, 0.0 kB/s 2024-05-08T20:58:57.369 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.369 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.369 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500416 s, 0.0 kB/s 2024-05-08T20:58:57.382 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.382 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.382 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473459 s, 0.0 kB/s 2024-05-08T20:58:57.397 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.397 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.397 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00550266 s, 0.0 kB/s 2024-05-08T20:58:57.410 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.410 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.410 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00490341 s, 0.0 kB/s 2024-05-08T20:58:57.423 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.423 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.423 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502068 s, 0.0 kB/s 2024-05-08T20:58:57.433 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.433 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.434 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00451952 s, 0.0 kB/s 2024-05-08T20:58:57.445 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.445 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.445 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00433193 s, 0.0 kB/s 2024-05-08T20:58:57.456 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.457 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.457 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00494678 s, 0.0 kB/s 2024-05-08T20:58:57.470 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.470 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.470 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00564106 s, 0.0 kB/s 2024-05-08T20:58:57.482 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.483 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.483 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00517884 s, 0.0 kB/s 2024-05-08T20:58:57.496 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.496 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.496 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00542795 s, 0.0 kB/s 2024-05-08T20:58:57.509 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.509 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.509 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00504187 s, 0.0 kB/s 2024-05-08T20:58:57.522 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.522 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.522 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00568588 s, 0.0 kB/s 2024-05-08T20:58:57.535 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.535 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.535 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00496054 s, 0.0 kB/s 2024-05-08T20:58:57.548 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.548 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.548 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00567077 s, 0.0 kB/s 2024-05-08T20:58:57.561 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.561 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.561 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00518548 s, 0.0 kB/s 2024-05-08T20:58:57.575 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.575 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.575 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00561257 s, 0.0 kB/s 2024-05-08T20:58:57.588 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.588 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.588 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497898 s, 0.0 kB/s 2024-05-08T20:58:57.601 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.601 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.601 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00528188 s, 0.0 kB/s 2024-05-08T20:58:57.614 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.614 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.614 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00510391 s, 0.0 kB/s 2024-05-08T20:58:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.627 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00524521 s, 0.0 kB/s 2024-05-08T20:58:57.640 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.641 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.641 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00509698 s, 0.0 kB/s 2024-05-08T20:58:57.653 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.654 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.654 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00522548 s, 0.0 kB/s 2024-05-08T20:58:57.666 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.666 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.666 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052514 s, 0.0 kB/s 2024-05-08T20:58:57.680 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.680 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.680 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00550261 s, 0.0 kB/s 2024-05-08T20:58:57.692 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.692 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.692 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486915 s, 0.0 kB/s 2024-05-08T20:58:57.705 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.705 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.705 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00509988 s, 0.0 kB/s 2024-05-08T20:58:57.718 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.718 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.718 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00451522 s, 0.0 kB/s 2024-05-08T20:58:57.731 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.731 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.732 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00508885 s, 0.0 kB/s 2024-05-08T20:58:57.744 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.744 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.744 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00459441 s, 0.0 kB/s 2024-05-08T20:58:57.757 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.757 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.757 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488233 s, 0.0 kB/s 2024-05-08T20:58:57.770 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.771 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.771 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483979 s, 0.0 kB/s 2024-05-08T20:58:57.784 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.784 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.784 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00471771 s, 0.0 kB/s 2024-05-08T20:58:57.797 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.797 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.797 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00495593 s, 0.0 kB/s 2024-05-08T20:58:57.810 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.810 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.810 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00395351 s, 0.0 kB/s 2024-05-08T20:58:57.818 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.818 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.818 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00339771 s, 0.0 kB/s 2024-05-08T20:58:57.828 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.828 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.828 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00404333 s, 0.0 kB/s 2024-05-08T20:58:57.839 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.839 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.839 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00464319 s, 0.0 kB/s 2024-05-08T20:58:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.851 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00457354 s, 0.0 kB/s 2024-05-08T20:58:57.864 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.864 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.864 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00524459 s, 0.0 kB/s 2024-05-08T20:58:57.878 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.878 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.878 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00481093 s, 0.0 kB/s 2024-05-08T20:58:57.891 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.891 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.891 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00518385 s, 0.0 kB/s 2024-05-08T20:58:57.905 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.905 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.905 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513168 s, 0.0 kB/s 2024-05-08T20:58:57.919 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.919 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.919 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00521905 s, 0.0 kB/s 2024-05-08T20:58:57.932 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.932 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.933 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507864 s, 0.0 kB/s 2024-05-08T20:58:57.946 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.946 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.946 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525752 s, 0.0 kB/s 2024-05-08T20:58:57.958 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.958 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.958 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473846 s, 0.0 kB/s 2024-05-08T20:58:57.970 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.970 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.970 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513801 s, 0.0 kB/s 2024-05-08T20:58:57.982 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.982 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.982 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00512613 s, 0.0 kB/s 2024-05-08T20:58:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:57.995 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497644 s, 0.0 kB/s 2024-05-08T20:58:58.007 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.007 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.007 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00503066 s, 0.0 kB/s 2024-05-08T20:58:58.020 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.020 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.020 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00504808 s, 0.0 kB/s 2024-05-08T20:58:58.032 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.032 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.033 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046896 s, 0.0 kB/s 2024-05-08T20:58:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.045 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486973 s, 0.0 kB/s 2024-05-08T20:58:58.058 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.058 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.058 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00479945 s, 0.0 kB/s 2024-05-08T20:58:58.071 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.071 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.071 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00502472 s, 0.0 kB/s 2024-05-08T20:58:58.083 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.083 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.084 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00493008 s, 0.0 kB/s 2024-05-08T20:58:58.096 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.097 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.097 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00527641 s, 0.0 kB/s 2024-05-08T20:58:58.109 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.109 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.109 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500684 s, 0.0 kB/s 2024-05-08T20:58:58.122 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.122 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.122 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00525701 s, 0.0 kB/s 2024-05-08T20:58:58.134 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.135 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.135 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00468418 s, 0.0 kB/s 2024-05-08T20:58:58.148 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.148 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.148 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00520727 s, 0.0 kB/s 2024-05-08T20:58:58.160 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.160 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.160 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486611 s, 0.0 kB/s 2024-05-08T20:58:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.173 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00507658 s, 0.0 kB/s 2024-05-08T20:58:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.186 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00521471 s, 0.0 kB/s 2024-05-08T20:58:58.198 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.198 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.198 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00500287 s, 0.0 kB/s 2024-05-08T20:58:58.211 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.211 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.211 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00511706 s, 0.0 kB/s 2024-05-08T20:58:58.223 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.224 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.224 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00487085 s, 0.0 kB/s 2024-05-08T20:58:58.237 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.237 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.237 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00547425 s, 0.0 kB/s 2024-05-08T20:58:58.249 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.250 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.250 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00464793 s, 0.0 kB/s 2024-05-08T20:58:58.262 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.263 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052096 s, 0.0 kB/s 2024-05-08T20:58:58.305 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.306 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.306 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0281118 s, 0.0 kB/s 2024-05-08T20:58:58.319 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.319 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.319 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00644275 s, 0.0 kB/s 2024-05-08T20:58:58.330 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.330 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.330 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00389465 s, 0.0 kB/s 2024-05-08T20:58:58.340 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.340 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.340 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00390517 s, 0.0 kB/s 2024-05-08T20:58:58.351 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.351 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.351 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00419349 s, 0.0 kB/s 2024-05-08T20:58:58.363 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.363 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.363 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00434822 s, 0.0 kB/s 2024-05-08T20:58:58.375 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.376 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.376 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00524866 s, 0.0 kB/s 2024-05-08T20:58:58.388 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.388 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.388 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00484857 s, 0.0 kB/s 2024-05-08T20:58:58.402 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.402 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.402 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00589531 s, 0.0 kB/s 2024-05-08T20:58:58.416 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.416 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.416 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00542804 s, 0.0 kB/s 2024-05-08T20:58:58.429 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.429 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.429 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00549633 s, 0.0 kB/s 2024-05-08T20:58:58.442 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.442 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.442 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00529149 s, 0.0 kB/s 2024-05-08T20:58:58.455 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.455 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.456 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00563674 s, 0.0 kB/s 2024-05-08T20:58:58.469 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.469 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.469 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00589281 s, 0.0 kB/s 2024-05-08T20:58:58.482 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.482 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.482 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00486091 s, 0.0 kB/s 2024-05-08T20:58:58.495 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.495 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.495 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00542664 s, 0.0 kB/s 2024-05-08T20:58:58.508 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.508 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.508 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00524612 s, 0.0 kB/s 2024-05-08T20:58:58.521 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.521 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.521 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0053679 s, 0.0 kB/s 2024-05-08T20:58:58.533 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.533 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.533 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480677 s, 0.0 kB/s 2024-05-08T20:58:58.546 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.546 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.546 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00528181 s, 0.0 kB/s 2024-05-08T20:58:58.558 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.558 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.558 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00469977 s, 0.0 kB/s 2024-05-08T20:58:58.571 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.571 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.571 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00497724 s, 0.0 kB/s 2024-05-08T20:58:58.583 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.583 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.583 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488766 s, 0.0 kB/s 2024-05-08T20:58:58.596 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.597 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.597 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00549753 s, 0.0 kB/s 2024-05-08T20:58:58.610 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.610 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.610 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00505248 s, 0.0 kB/s 2024-05-08T20:58:58.622 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.622 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.622 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00503214 s, 0.0 kB/s 2024-05-08T20:58:58.637 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.637 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.637 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00479759 s, 0.0 kB/s 2024-05-08T20:58:58.648 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.648 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.649 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00546053 s, 0.0 kB/s 2024-05-08T20:58:58.661 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.661 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.661 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00483195 s, 0.0 kB/s 2024-05-08T20:58:58.674 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.674 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.674 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00535103 s, 0.0 kB/s 2024-05-08T20:58:58.687 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.687 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.687 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00498248 s, 0.0 kB/s 2024-05-08T20:58:58.699 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.699 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.699 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00488069 s, 0.0 kB/s 2024-05-08T20:58:58.712 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.712 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.712 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0049334 s, 0.0 kB/s 2024-05-08T20:58:58.724 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.725 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.725 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046804 s, 0.0 kB/s 2024-05-08T20:58:58.737 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.738 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.738 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0053695 s, 0.0 kB/s 2024-05-08T20:58:58.749 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.749 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.750 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0046504 s, 0.0 kB/s 2024-05-08T20:58:58.761 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.761 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.761 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00504239 s, 0.0 kB/s 2024-05-08T20:58:58.773 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.773 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.773 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00473713 s, 0.0 kB/s 2024-05-08T20:58:58.785 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.786 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.786 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00498418 s, 0.0 kB/s 2024-05-08T20:58:58.798 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.798 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.798 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00467589 s, 0.0 kB/s 2024-05-08T20:58:58.811 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.811 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.811 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00501053 s, 0.0 kB/s 2024-05-08T20:58:58.823 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.823 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.823 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00480141 s, 0.0 kB/s 2024-05-08T20:58:58.836 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.836 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.837 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.0052737 s, 0.0 kB/s 2024-05-08T20:58:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.849 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00506 s, 0.0 kB/s 2024-05-08T20:58:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records in 2024-05-08T20:58:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:0+0 records out 2024-05-08T20:58:58.862 INFO:tasks.workunit.client.0.smithi107.stderr:0 bytes copied, 0.00513888 s, 0.0 kB/s 2024-05-08T20:58:58.864 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:58:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_dirs 500 2024-05-08T20:58:58.865 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:59:05.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:59:05.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_nodes 500 2024-05-08T20:59:05.446 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:59:10.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:10.841 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:11.587 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:59:11.587 INFO:tasks.workunit.client.0.smithi107.stderr:+ rename_files 500 2024-05-08T20:59:11.587 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:59:21.833 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:59:21.834 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_symlinks 500 2024-05-08T20:59:21.834 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:59:25.879 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:59:25.879 INFO:tasks.workunit.client.0.smithi107.stderr:+ make_links 500 2024-05-08T20:59:25.879 INFO:tasks.workunit.client.0.smithi107.stderr:+ set +x 2024-05-08T20:59:36.644 INFO:tasks.workunit.client.0.smithi107.stderr:+ return 0 2024-05-08T20:59:36.645 INFO:tasks.workunit.client.0.smithi107.stderr:+ cleanup 2024-05-08T20:59:36.653 INFO:tasks.workunit.client.0.smithi107.stderr:+ rm -rf link_test_gJ8q3V link_test_gTOUtG link_test_JCSsHj mkdir_test_49FrMr mkdir_test_B1Y8H8 mkdir_test_OWkfWf mkfile_test_7f5Gxy mkfile_test_fg7dlw mkfile_test_qgphd1 mknod_test_nga9rR mknod_test_tI4jBv mknod_test_ZiQHDn rename_test_gYvD2Y rename_test_owQcGR rename_test_XldBoh symlink_test_fw2aKV symlink_test_Jn9iAr symlink_test_KF6sGT 2024-05-08T20:59:40.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:40.916 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T20:59:58.675 INFO:tasks.workunit.client.0.smithi107.stderr:+ popd 2024-05-08T20:59:58.678 INFO:tasks.workunit.client.0.smithi107.stdout:~/cephtest/mnt.0/client.0/tmp 2024-05-08T20:59:58.678 INFO:tasks.workunit.client.0.smithi107.stdout:OK 2024-05-08T20:59:58.679 INFO:tasks.workunit.client.0.smithi107.stderr:+ echo OK 2024-05-08T20:59:58.680 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T20:59:58.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T20:59:58.732 INFO:tasks.workunit:Stopping ['fs/maxentries'] on client.0... 2024-05-08T20:59:58.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T20:59:58.992 DEBUG:teuthology.parallel:result is None 2024-05-08T20:59:58.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:59:59.029 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:59:59.029 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-08T20:59:59.052 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-08T20:59:59.053 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:59:59.053 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:59:59.086 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T20:59:59.086 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:59:59.100 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:59:59.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.261+0000 7f1887fff700 1 Processor -- start 2024-05-08T20:59:59.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.261+0000 7f1887fff700 1 -- start start 2024-05-08T20:59:59.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18880ce9d0 0x7f18880cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18880cee10 0x7f18880cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18880cd4b0 con 0x7f188815b180 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880cc5c0 con 0x7f18880cee10 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18880cc8a0 con 0x7f18880ce9d0 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18877fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f18880cee10 0x7f18880cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1886ffd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f188815b180 0x7f18880b0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35974/0 (socket says 172.21.15.107:35974) 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1886ffd700 1 -- 172.21.15.107:0/1159710703 learned_addr learned my addr 172.21.15.107:0/1159710703 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18867fc700 1 --2- 172.21.15.107:0/1159710703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18880ce9d0 0x7f18880cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18877fe700 1 -- 172.21.15.107:0/1159710703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18880ce9d0 msgr2=0x7f18880cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18877fe700 1 --2- 172.21.15.107:0/1159710703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18880ce9d0 0x7f18880cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18877fe700 1 -- 172.21.15.107:0/1159710703 >> v1:172.21.15.107:6789/0 conn(0x7f188815b180 legacy=0x7f18880b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18877fe700 1 -- 172.21.15.107:0/1159710703 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18880ccb80 con 0x7f18880cee10 2024-05-08T20:59:59.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1885ffb700 1 -- 172.21.15.107:0/1159710703 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022344554 0 0) 0x7f18880cd4b0 con 0x7f188815b180 2024-05-08T20:59:59.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f18877fe700 1 --2- 172.21.15.107:0/1159710703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f18880cf920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1880009d90 tx=0x7f188000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1feee30c79d8d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1885ffb700 1 -- 172.21.15.107:0/1159710703 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188000e070 con 0x7f18880cee10 2024-05-08T20:59:59.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1885ffb700 1 -- 172.21.15.107:0/1159710703 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188000bb20 con 0x7f18880cee10 2024-05-08T20:59:59.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1885ffb700 1 -- 172.21.15.107:0/1159710703 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880012430 con 0x7f18880cee10 2024-05-08T20:59:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- 172.21.15.107:0/1159710703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 msgr2=0x7f18880cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 --2- 172.21.15.107:0/1159710703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f18880cf920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1880009d90 tx=0x7f188000b330 comp rx=0 tx=0).stop 2024-05-08T20:59:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- 172.21.15.107:0/1159710703 shutdown_connections 2024-05-08T20:59:59.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 --2- 172.21.15.107:0/1159710703 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f18880cf920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 --2- 172.21.15.107:0/1159710703 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f18880ce9d0 0x7f18880cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- 172.21.15.107:0/1159710703 >> 172.21.15.107:0/1159710703 conn(0x7f18880b2970 msgr2=0x7f18880b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- 172.21.15.107:0/1159710703 shutdown_connections 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.265+0000 7f1887fff700 1 -- 172.21.15.107:0/1159710703 wait complete. 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 Processor -- start 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 -- start start 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18880ce9d0 0x7f1888155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f188806f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f188815b180 0x7f188806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18880b6cb0 con 0x7f18880cee10 2024-05-08T20:59:59.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18880b4530 con 0x7f18880ce9d0 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1887fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1888155f90 con 0x7f188815b180 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f188806f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f188806f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56744/0 (socket says 172.21.15.107:56744) 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 -- 172.21.15.107:0/4041849513 learned_addr learned my addr 172.21.15.107:0/4041849513 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f1886ffd700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18880ce9d0 0x7f1888155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18877fe700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f188815b180 0x7f188806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 -- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f188815b180 msgr2=0x7f188806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f188815b180 0x7f188806fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 -- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18880ce9d0 msgr2=0x7f1888155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18880ce9d0 0x7f1888155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 -- 172.21.15.107:0/4041849513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880009a70 con 0x7f18880cee10 2024-05-08T20:59:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.269+0000 7f18867fc700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f188806f630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f187800ebe0 tx=0x7f187800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878009740 con 0x7f18880cee10 2024-05-08T20:59:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187800c850 con 0x7f18880cee10 2024-05-08T20:59:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18880b3c00 con 0x7f18880cee10 2024-05-08T20:59:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187800cbe0 con 0x7f18880cee10 2024-05-08T20:59:59.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18880b41c0 con 0x7f18880cee10 2024-05-08T20:59:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18880d0360 con 0x7f18880cee10 2024-05-08T20:59:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f187800cd40 con 0x7f18880cee10 2024-05-08T20:59:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.273+0000 7f186f7fe700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1874066730 0x7f1874068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.277+0000 7f1886ffd700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1874066730 0x7f1874068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.277+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f1878084190 con 0x7f18880cee10 2024-05-08T20:59:59.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.277+0000 7f1886ffd700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1874066730 0x7f1874068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f187c000f60 tx=0x7f187c007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.281+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f18780514c0 con 0x7f18880cee10 2024-05-08T20:59:59.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.453+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18880672a0 con 0x7f18880cee10 2024-05-08T20:59:59.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f186f7fe700 1 -- 172.21.15.107:0/4041849513 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f1878054ae0 con 0x7f18880cee10 2024-05-08T20:59:59.463 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T20:59:59.463 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:59:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1874066730 msgr2=0x7f1874068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1874066730 0x7f1874068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f187c000f60 tx=0x7f187c007e90 comp rx=0 tx=0).stop 2024-05-08T20:59:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 msgr2=0x7f188806f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f188806f630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f187800ebe0 tx=0x7f187800eef0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 shutdown_connections 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1874066730 0x7f1874068bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f188815b180 0x7f188806fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f18880cee10 0x7f188806f630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 --2- 172.21.15.107:0/4041849513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18880ce9d0 0x7f1888155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 >> 172.21.15.107:0/4041849513 conn(0x7f18880b2970 msgr2=0x7f18881595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 shutdown_connections 2024-05-08T20:59:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.457+0000 7f1887fff700 1 -- 172.21.15.107:0/4041849513 wait complete. 2024-05-08T20:59:59.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:59:59.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:59:59.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 Processor -- start 2024-05-08T20:59:59.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 -- start start 2024-05-08T20:59:59.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f04d4160920 0x7f04d40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04d40d1da0 0x7f04d40cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d40d3d40 con 0x7f04d40cec30 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40d0d00 con 0x7f04d40d1da0 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.589+0000 7f04d3fff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40d0fe0 con 0x7f04d4160920 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d37fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f04d40cec30 0x7f04d4161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35984/0 (socket says 172.21.15.107:35984) 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d27fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f04d40d1da0 0x7f04d40cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d37fe700 1 -- 172.21.15.107:0/2231652263 learned_addr learned my addr 172.21.15.107:0/2231652263 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d2ffd700 1 --2- 172.21.15.107:0/2231652263 >> v2:172.21.15.195:3300/0 conn(0x7f04d4160920 0x7f04d40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d27fc700 1 -- 172.21.15.107:0/2231652263 >> v2:172.21.15.195:3300/0 conn(0x7f04d4160920 msgr2=0x7f04d40ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d27fc700 1 --2- 172.21.15.107:0/2231652263 >> v2:172.21.15.195:3300/0 conn(0x7f04d4160920 0x7f04d40ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d27fc700 1 -- 172.21.15.107:0/2231652263 >> v1:172.21.15.107:6789/0 conn(0x7f04d40cec30 legacy=0x7f04d4161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d1ffb700 1 -- 172.21.15.107:0/2231652263 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063578489 0 0) 0x7f04d40d3d40 con 0x7f04d40cec30 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d27fc700 1 -- 172.21.15.107:0/2231652263 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40d12c0 con 0x7f04d40d1da0 2024-05-08T20:59:59.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d27fc700 1 --2- 172.21.15.107:0/2231652263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40cf940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04d408c490 tx=0x7f04bc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcebf39059da283f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d1ffb700 1 -- 172.21.15.107:0/2231652263 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc011830 con 0x7f04d40d1da0 2024-05-08T20:59:59.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d1ffb700 1 -- 172.21.15.107:0/2231652263 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc011990 con 0x7f04d40d1da0 2024-05-08T20:59:59.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d1ffb700 1 -- 172.21.15.107:0/2231652263 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc011d40 con 0x7f04d40d1da0 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 -- 172.21.15.107:0/2231652263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 msgr2=0x7f04d40cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 --2- 172.21.15.107:0/2231652263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40cf940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04d408c490 tx=0x7f04bc009b30 comp rx=0 tx=0).stop 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 -- 172.21.15.107:0/2231652263 shutdown_connections 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 --2- 172.21.15.107:0/2231652263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40cf940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 --2- 172.21.15.107:0/2231652263 >> v2:172.21.15.195:3300/0 conn(0x7f04d4160920 0x7f04d40ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 -- 172.21.15.107:0/2231652263 >> 172.21.15.107:0/2231652263 conn(0x7f04d409c340 msgr2=0x7f04d40d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 -- 172.21.15.107:0/2231652263 shutdown_connections 2024-05-08T20:59:59.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.593+0000 7f04d3fff700 1 -- 172.21.15.107:0/2231652263 wait complete. 2024-05-08T20:59:59.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 Processor -- start 2024-05-08T20:59:59.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 -- start start 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d40cec30 0x7f04d414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04d4160920 0x7f04d40b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d414c2f0 con 0x7f04d40d1da0 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40b2e10 con 0x7f04d4160920 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d414c590 con 0x7f04d40cec30 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56760/0 (socket says 172.21.15.107:56760) 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 -- 172.21.15.107:0/1774943083 learned_addr learned my addr 172.21.15.107:0/1774943083 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:59:59.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d2ffd700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d40cec30 0x7f04d414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d37fe700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04d4160920 0x7f04d40b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 -- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d40cec30 msgr2=0x7f04d414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d40cec30 0x7f04d414bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 -- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04d4160920 msgr2=0x7f04d40b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04d4160920 0x7f04d40b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 -- 172.21.15.107:0/1774943083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0094b0 con 0x7f04d40d1da0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d27fc700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04bc014040 tx=0x7f04bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc019980 con 0x7f04d40d1da0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc01e070 con 0x7f04d40d1da0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d4160e80 con 0x7f04d40d1da0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc019d40 con 0x7f04d40d1da0 2024-05-08T20:59:59.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.597+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d414c850 con 0x7f04d40d1da0 2024-05-08T20:59:59.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.601+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d40684b0 con 0x7f04d40d1da0 2024-05-08T20:59:59.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.601+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04bc02d430 con 0x7f04d40d1da0 2024-05-08T20:59:59.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.601+0000 7f04cbfff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f04b4066760 0x7f04b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.601+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f04bc0851f0 con 0x7f04d40d1da0 2024-05-08T20:59:59.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.601+0000 7f04d2ffd700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f04b4066760 0x7f04b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.601+0000 7f04d2ffd700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f04b4066760 0x7f04b4068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007a60 tx=0x7f04c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.609+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f04bc052530 con 0x7f04d40d1da0 2024-05-08T20:59:59.784 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.777+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04d40cf510 con 0x7f04d40d1da0 2024-05-08T20:59:59.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.777+0000 7f04cbfff700 1 -- 172.21.15.107:0/1774943083 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04bc020020 con 0x7f04d40d1da0 2024-05-08T20:59:59.785 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T20:59:59.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f04b4066760 msgr2=0x7f04b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f04b4066760 0x7f04b4068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007a60 tx=0x7f04c4008040 comp rx=0 tx=0).stop 2024-05-08T20:59:59.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 msgr2=0x7f04d40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04bc014040 tx=0x7f04bc004770 comp rx=0 tx=0).stop 2024-05-08T20:59:59.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 shutdown_connections 2024-05-08T20:59:59.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04d4160920 0x7f04d40b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f04d40d1da0 0x7f04d40b4d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f04b4066760 0x7f04b4068c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 --2- 172.21.15.107:0/1774943083 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f04d40cec30 0x7f04d414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 >> 172.21.15.107:0/1774943083 conn(0x7f04d409c340 msgr2=0x7f04d415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:59:59.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 shutdown_connections 2024-05-08T20:59:59.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.781+0000 7f04d3fff700 1 -- 172.21.15.107:0/1774943083 wait complete. 2024-05-08T20:59:59.799 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:59:59.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 Processor -- start 2024-05-08T20:59:59.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 -- start start 2024-05-08T20:59:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f00340d1da0 0x7f00340cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00340cfe80 0x7f00340b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340d3d40 con 0x7f0034160920 2024-05-08T20:59:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00340d02d0 con 0x7f00340cfe80 2024-05-08T20:59:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0033fff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00340d0d00 con 0x7f00340d1da0 2024-05-08T20:59:59.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0032ffd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0034160920 0x7f00340ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35988/0 (socket says 172.21.15.107:35988) 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f0032ffd700 1 -- 172.21.15.107:0/233595751 learned_addr learned my addr 172.21.15.107:0/233595751 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f00337fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00340cfe80 0x7f00340b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.913+0000 7f00327fc700 1 --2- 172.21.15.107:0/233595751 >> v2:172.21.15.195:3300/0 conn(0x7f00340d1da0 0x7f00340cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f00337fe700 1 -- 172.21.15.107:0/233595751 >> v2:172.21.15.195:3300/0 conn(0x7f00340d1da0 msgr2=0x7f00340cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f00337fe700 1 --2- 172.21.15.107:0/233595751 >> v2:172.21.15.195:3300/0 conn(0x7f00340d1da0 0x7f00340cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f00337fe700 1 -- 172.21.15.107:0/233595751 >> v1:172.21.15.107:6789/0 conn(0x7f0034160920 legacy=0x7f00340ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f00337fe700 1 -- 172.21.15.107:0/233595751 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00340d0fe0 con 0x7f00340cfe80 2024-05-08T20:59:59.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f00337fe700 1 --2- 172.21.15.107:0/233595751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f00340b5e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00340b90b0 tx=0x7f002c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cff771adbef229 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0031ffb700 1 -- 172.21.15.107:0/233595751 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00e070 con 0x7f00340cfe80 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0031ffb700 1 -- 172.21.15.107:0/233595751 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00bb20 con 0x7f00340cfe80 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0031ffb700 1 -- 172.21.15.107:0/233595751 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c012430 con 0x7f00340cfe80 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 -- 172.21.15.107:0/233595751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 msgr2=0x7f00340b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 --2- 172.21.15.107:0/233595751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f00340b5e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00340b90b0 tx=0x7f002c00b330 comp rx=0 tx=0).stop 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 -- 172.21.15.107:0/233595751 shutdown_connections 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 --2- 172.21.15.107:0/233595751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f00340b5e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 --2- 172.21.15.107:0/233595751 >> v2:172.21.15.195:3300/0 conn(0x7f00340d1da0 0x7f00340cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 -- 172.21.15.107:0/233595751 >> 172.21.15.107:0/233595751 conn(0x7f003409c340 msgr2=0x7f00340d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:59:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 -- 172.21.15.107:0/233595751 shutdown_connections 2024-05-08T20:59:59.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.917+0000 7f0033fff700 1 -- 172.21.15.107:0/233595751 wait complete. 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 Processor -- start 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- start start 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f003415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00340d1da0 0x7f00340a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0034160920 0x7f003409d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00340a0180 con 0x7f00340cfe80 2024-05-08T20:59:59.932 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00340a0b50 con 0x7f00340d1da0 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003409dc70 con 0x7f0034160920 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f003415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f003415ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56774/0 (socket says 172.21.15.107:56774) 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 -- 172.21.15.107:0/2403616700 learned_addr learned my addr 172.21.15.107:0/2403616700 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f00327fc700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00340d1da0 0x7f00340a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f00337fe700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0034160920 0x7f003409d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 -- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0034160920 msgr2=0x7f003409d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0034160920 0x7f003409d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 -- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00340d1da0 msgr2=0x7f00340a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00340d1da0 0x7f00340a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 -- 172.21.15.107:0/2403616700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009a70 con 0x7f00340cfe80 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0032ffd700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f003415ea20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f002800c4d0 tx=0x7f002800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028005d90 con 0x7f00340cfe80 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00280070d0 con 0x7f00340cfe80 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003409f570 con 0x7f00340cfe80 2024-05-08T20:59:59.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028007440 con 0x7f00340cfe80 2024-05-08T20:59:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003409fb30 con 0x7f00340cfe80 2024-05-08T20:59:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.921+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00340684b0 con 0x7f00340cfe80 2024-05-08T20:59:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.925+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f00280075a0 con 0x7f00340cfe80 2024-05-08T20:59:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.925+0000 7f001bfff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0020066730 0x7f0020068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:59:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.925+0000 7f00327fc700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0020066730 0x7f0020068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:59:59.935 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.925+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f0028083610 con 0x7f00340cfe80 2024-05-08T20:59:59.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.925+0000 7f00327fc700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0020066730 0x7f0020068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00340b47a0 tx=0x7f0024008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:59:59.939 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T20:59:59.933+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f00280508c0 con 0x7f00340cfe80 2024-05-08T21:00:00.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.101+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00340cf510 con 0x7f00340cfe80 2024-05-08T21:00:00.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.101+0000 7f001bfff700 1 -- 172.21.15.107:0/2403616700 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0028053ee0 con 0x7f00340cfe80 2024-05-08T21:00:00.110 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:00.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0020066730 msgr2=0x7f0020068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0020066730 0x7f0020068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00340b47a0 tx=0x7f0024008040 comp rx=0 tx=0).stop 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 msgr2=0x7f003415ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f003415ea20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f002800c4d0 tx=0x7f002800c890 comp rx=0 tx=0).stop 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 shutdown_connections 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f0020066730 0x7f0020068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f0034160920 0x7f003409d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00340d1da0 0x7f00340a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 --2- 172.21.15.107:0/2403616700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00340cfe80 0x7f003415ea20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 >> 172.21.15.107:0/2403616700 conn(0x7f003409c340 msgr2=0x7f003406afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 shutdown_connections 2024-05-08T21:00:00.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.105+0000 7f0033fff700 1 -- 172.21.15.107:0/2403616700 wait complete. 2024-05-08T21:00:00.125 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:00.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 Processor -- start 2024-05-08T21:00:00.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 -- start start 2024-05-08T21:00:00.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f89380cb3b0 0x7f8938147930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8938165260 0x7f8938162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8938161c70 con 0x7f8938162990 2024-05-08T21:00:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8938144ac0 con 0x7f8938165260 2024-05-08T21:00:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893d1c4700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8938165a00 con 0x7f89380cb3b0 2024-05-08T21:00:00.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f8936d9d700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f89380cb3b0 0x7f8938147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f8936d9d700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f89380cb3b0 0x7f8938147930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55400/0 (socket says 172.21.15.107:55400) 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f8936d9d700 1 -- 172.21.15.107:0/3367051538 learned_addr learned my addr 172.21.15.107:0/3367051538 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893659c700 1 --2- 172.21.15.107:0/3367051538 >> v2:172.21.15.107:3300/0 conn(0x7f8938165260 0x7f8938162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893659c700 1 -- 172.21.15.107:0/3367051538 >> v2:172.21.15.195:3300/0 conn(0x7f89380cb3b0 msgr2=0x7f8938147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893659c700 1 --2- 172.21.15.107:0/3367051538 >> v2:172.21.15.195:3300/0 conn(0x7f89380cb3b0 0x7f8938147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893659c700 1 -- 172.21.15.107:0/3367051538 >> v1:172.21.15.195:6789/0 conn(0x7f8938162990 legacy=0x7f893806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893659c700 1 -- 172.21.15.107:0/3367051538 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938165ce0 con 0x7f8938165260 2024-05-08T21:00:00.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f893659c700 1 --2- 172.21.15.107:0/3367051538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8938165260 0x7f8938162450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8928009850 tx=0x7f8928009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1d170c17346fa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f8935d9b700 1 -- 172.21.15.107:0/3367051538 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928011830 con 0x7f8938165260 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f8935d9b700 1 -- 172.21.15.107:0/3367051538 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928011990 con 0x7f8938165260 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.249+0000 7f8935d9b700 1 -- 172.21.15.107:0/3367051538 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928011d20 con 0x7f8938165260 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 -- 172.21.15.107:0/3367051538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8938165260 msgr2=0x7f8938162450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 --2- 172.21.15.107:0/3367051538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8938165260 0x7f8938162450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8928009850 tx=0x7f8928009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 -- 172.21.15.107:0/3367051538 shutdown_connections 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 --2- 172.21.15.107:0/3367051538 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8938165260 0x7f8938162450 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 --2- 172.21.15.107:0/3367051538 >> v2:172.21.15.195:3300/0 conn(0x7f89380cb3b0 0x7f8938147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 -- 172.21.15.107:0/3367051538 >> 172.21.15.107:0/3367051538 conn(0x7f89380b0cd0 msgr2=0x7f89380b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 -- 172.21.15.107:0/3367051538 shutdown_connections 2024-05-08T21:00:00.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 -- 172.21.15.107:0/3367051538 wait complete. 2024-05-08T21:00:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 Processor -- start 2024-05-08T21:00:00.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.253+0000 7f893d1c4700 1 -- start start 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 0x7f8938157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893815b690 0x7f893815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893815c920 0x7f8938159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815b270 con 0x7f89380cb3b0 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815cda0 con 0x7f893815c920 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8938157970 con 0x7f893815b690 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 0x7f8938157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 0x7f8938157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56790/0 (socket says 172.21.15.107:56790) 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 -- 172.21.15.107:0/2042162884 learned_addr learned my addr 172.21.15.107:0/2042162884 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893759e700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893815c920 0x7f8938159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 -- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893815b690 msgr2=0x7f893815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893815b690 0x7f893815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 -- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893815c920 msgr2=0x7f8938159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893815c920 0x7f8938159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 -- 172.21.15.107:0/2042162884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280094b0 con 0x7f89380cb3b0 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f8936d9d700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 0x7f8938157430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f892000e930 tx=0x7f892000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200096c0 con 0x7f89380cb3b0 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000ee80 con 0x7f89380cb3b0 2024-05-08T21:00:00.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000ca90 con 0x7f89380cb3b0 2024-05-08T21:00:00.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893815a5f0 con 0x7f89380cb3b0 2024-05-08T21:00:00.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893815abb0 con 0x7f89380cb3b0 2024-05-08T21:00:00.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.257+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893815b3b0 con 0x7f89380cb3b0 2024-05-08T21:00:00.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.261+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f892000cbf0 con 0x7f89380cb3b0 2024-05-08T21:00:00.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.261+0000 7f892f7fe700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8918066780 0x7f8918068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.261+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f89200840c0 con 0x7f89380cb3b0 2024-05-08T21:00:00.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.261+0000 7f893659c700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8918066780 0x7f8918068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.261+0000 7f893659c700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8918066780 0x7f8918068c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8938165640 tx=0x7f8928010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.265+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f893815b3b0 con 0x7f89380cb3b0 2024-05-08T21:00:00.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f893815b3b0 con 0x7f89380cb3b0 2024-05-08T21:00:00.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f892f7fe700 1 -- 172.21.15.107:0/2042162884 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f893815b3b0 con 0x7f89380cb3b0 2024-05-08T21:00:00.436 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:00.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8918066780 msgr2=0x7f8918068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8918066780 0x7f8918068c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8938165640 tx=0x7f8928010000 comp rx=0 tx=0).stop 2024-05-08T21:00:00.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 msgr2=0x7f8938157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 0x7f8938157430 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f892000e930 tx=0x7f892000ec40 comp rx=0 tx=0).stop 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 shutdown_connections 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f893815c920 0x7f8938159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8918066780 0x7f8918068c40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f893815b690 0x7f893815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 --2- 172.21.15.107:0/2042162884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f89380cb3b0 0x7f8938157430 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 >> 172.21.15.107:0/2042162884 conn(0x7f89380b0cd0 msgr2=0x7f893806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 shutdown_connections 2024-05-08T21:00:00.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.429+0000 7f893d1c4700 1 -- 172.21.15.107:0/2042162884 wait complete. 2024-05-08T21:00:00.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:00.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.549+0000 7f9eaf59e700 1 Processor -- start 2024-05-08T21:00:00.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.549+0000 7f9eaf59e700 1 -- start start 2024-05-08T21:00:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9eb015d2c0 0x7f9eb00d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9eb00cf0d0 0x7f9eb006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00cf530 con 0x7f9eb0099a70 2024-05-08T21:00:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb006b510 con 0x7f9eb015d2c0 2024-05-08T21:00:00.561 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb009a760 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eae59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9eb015d2c0 0x7f9eb00d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaed9d700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9eb0099a70 0x7f9eb00cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:35996/0 (socket says 172.21.15.107:35996) 2024-05-08T21:00:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaed9d700 1 -- 172.21.15.107:0/4200678311 learned_addr learned my addr 172.21.15.107:0/4200678311 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eadd9b700 1 --2- 172.21.15.107:0/4200678311 >> v2:172.21.15.195:3300/0 conn(0x7f9eb00cf0d0 0x7f9eb006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eae59c700 1 -- 172.21.15.107:0/4200678311 >> v2:172.21.15.195:3300/0 conn(0x7f9eb00cf0d0 msgr2=0x7f9eb006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:00.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eae59c700 1 --2- 172.21.15.107:0/4200678311 >> v2:172.21.15.195:3300/0 conn(0x7f9eb00cf0d0 0x7f9eb006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eae59c700 1 -- 172.21.15.107:0/4200678311 >> v1:172.21.15.107:6789/0 conn(0x7f9eb0099a70 legacy=0x7f9eb00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eae59c700 1 -- 172.21.15.107:0/4200678311 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb006b780 con 0x7f9eb015d2c0 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9ead59a700 1 -- 172.21.15.107:0/4200678311 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850687600 0 0) 0x7f9eb00cf530 con 0x7f9eb0099a70 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eae59c700 1 --2- 172.21.15.107:0/4200678311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb015d2c0 0x7f9eb00d00f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0070d80 tx=0x7f9ea800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74cfe18724810616 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9ead59a700 1 -- 172.21.15.107:0/4200678311 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800e070 con 0x7f9eb015d2c0 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9ead59a700 1 -- 172.21.15.107:0/4200678311 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea800bbd0 con 0x7f9eb015d2c0 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9ead59a700 1 -- 172.21.15.107:0/4200678311 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8012430 con 0x7f9eb015d2c0 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- 172.21.15.107:0/4200678311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb015d2c0 msgr2=0x7f9eb00d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/4200678311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb015d2c0 0x7f9eb00d00f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0070d80 tx=0x7f9ea800b330 comp rx=0 tx=0).stop 2024-05-08T21:00:00.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- 172.21.15.107:0/4200678311 shutdown_connections 2024-05-08T21:00:00.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/4200678311 >> v2:172.21.15.195:3300/0 conn(0x7f9eb00cf0d0 0x7f9eb006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/4200678311 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb015d2c0 0x7f9eb00d00f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- 172.21.15.107:0/4200678311 >> 172.21.15.107:0/4200678311 conn(0x7f9eb00d0e90 msgr2=0x7f9eb00d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:00.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- 172.21.15.107:0/4200678311 shutdown_connections 2024-05-08T21:00:00.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- 172.21.15.107:0/4200678311 wait complete. 2024-05-08T21:00:00.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 Processor -- start 2024-05-08T21:00:00.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.553+0000 7f9eaf59e700 1 -- start start 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eb0099a70 0x7f9eb0157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 0x7f9eb00c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb015d2c0 0x7f9eb01f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00c9a00 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00c9ce0 con 0x7f9eb015d2c0 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00c9fc0 con 0x7f9eb0099a70 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 0x7f9eb00c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 0x7f9eb00c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56802/0 (socket says 172.21.15.107:56802) 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 -- 172.21.15.107:0/1285100822 learned_addr learned my addr 172.21.15.107:0/1285100822 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eae59c700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eb0099a70 0x7f9eb0157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaed9d700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb015d2c0 0x7f9eb01f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 -- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eb0099a70 msgr2=0x7f9eb0157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eb0099a70 0x7f9eb0157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 -- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb015d2c0 msgr2=0x7f9eb01f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb015d2c0 0x7f9eb01f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 -- 172.21.15.107:0/1285100822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8009a70 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eadd9b700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 0x7f9eb00c8fb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400e760 tx=0x7f9ea400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400c070 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4013610 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb00ca2a0 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4013980 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb0158380 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.557+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb00672a0 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.561+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ea4013ae0 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.561+0000 7f9e9effd700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9e90066730 0x7f9e90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.561+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f9ea4083ef0 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.561+0000 7f9eae59c700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9e90066730 0x7f9e90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.561+0000 7f9eae59c700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9e90066730 0x7f9e90068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8014040 tx=0x7f9ea8011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.565+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9ea4051220 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.753+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9eb00b1d00 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.753+0000 7f9e9effd700 1 -- 172.21.15.107:0/1285100822 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ea4054840 con 0x7f9eb00cf0d0 2024-05-08T21:00:00.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9e90066730 msgr2=0x7f9e90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9e90066730 0x7f9e90068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8014040 tx=0x7f9ea8011000 comp rx=0 tx=0).stop 2024-05-08T21:00:00.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 msgr2=0x7f9eb00c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 0x7f9eb00c8fb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400e760 tx=0x7f9ea400ea70 comp rx=0 tx=0).stop 2024-05-08T21:00:00.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 shutdown_connections 2024-05-08T21:00:00.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb015d2c0 0x7f9eb01f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9eb00cf0d0 0x7f9eb00c8fb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9e90066730 0x7f9e90068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 --2- 172.21.15.107:0/1285100822 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9eb0099a70 0x7f9eb0157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 >> 172.21.15.107:0/1285100822 conn(0x7f9eb00d0e90 msgr2=0x7f9eb00d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:00.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 shutdown_connections 2024-05-08T21:00:00.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.757+0000 7f9eaf59e700 1 -- 172.21.15.107:0/1285100822 wait complete. 2024-05-08T21:00:00.766 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:00.775 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T21:00:00.775 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:00.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:00.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 Processor -- start 2024-05-08T21:00:00.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 -- start start 2024-05-08T21:00:00.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4071e70 0x7f91c41624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f91c4070110 0x7f91c40705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c4158960 con 0x7f91c40b3c20 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40b1f60 con 0x7f91c4070110 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c3fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40ae990 con 0x7f91c4071e70 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c2ffd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f91c40b3c20 0x7f91c40b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36002/0 (socket says 172.21.15.107:36002) 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c2ffd700 1 -- 172.21.15.107:0/992897282 learned_addr learned my addr 172.21.15.107:0/992897282 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c27fc700 1 --2- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4071e70 0x7f91c41624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c37fe700 1 --2- 172.21.15.107:0/992897282 >> v2:172.21.15.195:3300/0 conn(0x7f91c4070110 0x7f91c40705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c1ffb700 1 -- 172.21.15.107:0/992897282 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292444258 0 0) 0x7f91c4158960 con 0x7f91c40b3c20 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c1ffb700 1 -- 172.21.15.107:0/992897282 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a40035d0 con 0x7f91c40b3c20 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c37fe700 1 -- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4071e70 msgr2=0x7f91c41624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c37fe700 1 --2- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4071e70 0x7f91c41624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c37fe700 1 -- 172.21.15.107:0/992897282 >> v1:172.21.15.107:6789/0 conn(0x7f91c40b3c20 legacy=0x7f91c40b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c37fe700 1 -- 172.21.15.107:0/992897282 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c40b2170 con 0x7f91c4070110 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c37fe700 1 --2- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4070110 0x7f91c40705a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009850 tx=0x7f91b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c409d1feb14f48a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c1ffb700 1 -- 172.21.15.107:0/992897282 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4011830 con 0x7f91c4070110 2024-05-08T21:00:00.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c1ffb700 1 -- 172.21.15.107:0/992897282 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4011990 con 0x7f91c4070110 2024-05-08T21:00:00.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.881+0000 7f91c1ffb700 1 -- 172.21.15.107:0/992897282 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4011d00 con 0x7f91c4070110 2024-05-08T21:00:00.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 -- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4070110 msgr2=0x7f91c40705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 --2- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4070110 0x7f91c40705a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009850 tx=0x7f91b4009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:00.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 -- 172.21.15.107:0/992897282 shutdown_connections 2024-05-08T21:00:00.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 --2- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4070110 0x7f91c40705a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 --2- 172.21.15.107:0/992897282 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4071e70 0x7f91c41624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 -- 172.21.15.107:0/992897282 >> 172.21.15.107:0/992897282 conn(0x7f91c406c330 msgr2=0x7f91c406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:00.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 -- 172.21.15.107:0/992897282 shutdown_connections 2024-05-08T21:00:00.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.885+0000 7f91c3fff700 1 -- 172.21.15.107:0/992897282 wait complete. 2024-05-08T21:00:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 Processor -- start 2024-05-08T21:00:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 -- start start 2024-05-08T21:00:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4070110 0x7f91c4150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4071e70 0x7f91c4152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 0x7f91c4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c41651e0 con 0x7f91c40b3c20 2024-05-08T21:00:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4150f30 con 0x7f91c4071e70 2024-05-08T21:00:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c4151210 con 0x7f91c4070110 2024-05-08T21:00:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 0x7f91c4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 0x7f91c4156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56812/0 (socket says 172.21.15.107:56812) 2024-05-08T21:00:00.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 -- 172.21.15.107:0/2493168646 learned_addr learned my addr 172.21.15.107:0/2493168646 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c2ffd700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4070110 0x7f91c4150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c27fc700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4071e70 0x7f91c4152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 -- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4070110 msgr2=0x7f91c4150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4070110 0x7f91c4150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 -- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4071e70 msgr2=0x7f91c4152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:00.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4071e70 0x7f91c4152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 -- 172.21.15.107:0/2493168646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40094b0 con 0x7f91c40b3c20 2024-05-08T21:00:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c2ffd700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4070110 0x7f91c4150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c37fe700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 0x7f91c4156dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91b40090b0 tx=0x7f91b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4004610 con 0x7f91c40b3c20 2024-05-08T21:00:00.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b401e070 con 0x7f91c40b3c20 2024-05-08T21:00:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c41514f0 con 0x7f91c40b3c20 2024-05-08T21:00:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4003920 con 0x7f91c40b3c20 2024-05-08T21:00:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.889+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c4157300 con 0x7f91c40b3c20 2024-05-08T21:00:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.893+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c4066150 con 0x7f91c40b3c20 2024-05-08T21:00:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.893+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91b4003a80 con 0x7f91c40b3c20 2024-05-08T21:00:00.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.893+0000 7f91bbfff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f91a8066730 0x7f91a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:00.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.893+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f91b4085200 con 0x7f91c40b3c20 2024-05-08T21:00:00.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.893+0000 7f91c2ffd700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f91a8066730 0x7f91a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:00.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.893+0000 7f91c2ffd700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f91a8066730 0x7f91a8068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005930 tx=0x7f91bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:00.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:00.897+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f91b4052490 con 0x7f91c40b3c20 2024-05-08T21:00:01.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.065+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91c40684b0 con 0x7f91c40b3c20 2024-05-08T21:00:01.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.069+0000 7f91bbfff700 1 -- 172.21.15.107:0/2493168646 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f91b4055ab0 con 0x7f91c40b3c20 2024-05-08T21:00:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:01.078 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:01.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f91a8066730 msgr2=0x7f91a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f91a8066730 0x7f91a8068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005930 tx=0x7f91bc009040 comp rx=0 tx=0).stop 2024-05-08T21:00:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 msgr2=0x7f91c4156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 0x7f91c4156dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f91b40090b0 tx=0x7f91b4004770 comp rx=0 tx=0).stop 2024-05-08T21:00:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 shutdown_connections 2024-05-08T21:00:01.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f91c40b3c20 0x7f91c4156dc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f91c4071e70 0x7f91c4152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f91a8066730 0x7f91a8068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 --2- 172.21.15.107:0/2493168646 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f91c4070110 0x7f91c4150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 >> 172.21.15.107:0/2493168646 conn(0x7f91c406c330 msgr2=0x7f91c40ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 shutdown_connections 2024-05-08T21:00:01.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.073+0000 7f91c3fff700 1 -- 172.21.15.107:0/2493168646 wait complete. 2024-05-08T21:00:01.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:01.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:01.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 Processor -- start 2024-05-08T21:00:01.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 -- start start 2024-05-08T21:00:01.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f01f4143850 0x7f01f415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415d9d0 0x7f01f415de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f4143c30 con 0x7f01f415e600 2024-05-08T21:00:01.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f40cfd50 con 0x7f01f4143850 2024-05-08T21:00:01.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f98b3700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f415e380 con 0x7f01f415d9d0 2024-05-08T21:00:01.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f88b1700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f01f4143850 0x7f01f415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f3fff700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f01f415e600 0x7f01f40cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36004/0 (socket says 172.21.15.107:36004) 2024-05-08T21:00:01.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f3fff700 1 -- 172.21.15.107:0/1964104720 learned_addr learned my addr 172.21.15.107:0/1964104720 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:01.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f90b2700 1 --2- 172.21.15.107:0/1964104720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415d9d0 0x7f01f415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f88b1700 1 -- 172.21.15.107:0/1964104720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415d9d0 msgr2=0x7f01f415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:01.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f88b1700 1 --2- 172.21.15.107:0/1964104720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415d9d0 0x7f01f415de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f88b1700 1 -- 172.21.15.107:0/1964104720 >> v1:172.21.15.107:6789/0 conn(0x7f01f415e600 legacy=0x7f01f40cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.197+0000 7f01f88b1700 1 -- 172.21.15.107:0/1964104720 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f40cfa70 con 0x7f01f4143850 2024-05-08T21:00:01.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f88b1700 1 --2- 172.21.15.107:0/1964104720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f4143850 0x7f01f415a3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009880 tx=0x7f01e8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c0574d424c313 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f37fe700 1 -- 172.21.15.107:0/1964104720 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8011830 con 0x7f01f4143850 2024-05-08T21:00:01.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f37fe700 1 -- 172.21.15.107:0/1964104720 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e8011990 con 0x7f01f4143850 2024-05-08T21:00:01.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f37fe700 1 -- 172.21.15.107:0/1964104720 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8011d20 con 0x7f01f4143850 2024-05-08T21:00:01.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/1964104720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f4143850 msgr2=0x7f01f415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 --2- 172.21.15.107:0/1964104720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f4143850 0x7f01f415a3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009880 tx=0x7f01e8009b90 comp rx=0 tx=0).stop 2024-05-08T21:00:01.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/1964104720 shutdown_connections 2024-05-08T21:00:01.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 --2- 172.21.15.107:0/1964104720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415d9d0 0x7f01f415de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 --2- 172.21.15.107:0/1964104720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f4143850 0x7f01f415a3e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/1964104720 >> 172.21.15.107:0/1964104720 conn(0x7f01f40b1c70 msgr2=0x7f01f40b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:01.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/1964104720 shutdown_connections 2024-05-08T21:00:01.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/1964104720 wait complete. 2024-05-08T21:00:01.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 Processor -- start 2024-05-08T21:00:01.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- start start 2024-05-08T21:00:01.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01f4143850 0x7f01f40b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 0x7f01f40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415e600 0x7f01f413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f414b1d0 con 0x7f01f415d9d0 2024-05-08T21:00:01.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4159c00 con 0x7f01f4143850 2024-05-08T21:00:01.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f413c7b0 con 0x7f01f415e600 2024-05-08T21:00:01.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 0x7f01f40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 0x7f01f40b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56824/0 (socket says 172.21.15.107:56824) 2024-05-08T21:00:01.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 -- 172.21.15.107:0/2629233603 learned_addr learned my addr 172.21.15.107:0/2629233603 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:01.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f90b2700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415e600 0x7f01f413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f88b1700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01f4143850 0x7f01f40b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 -- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415e600 msgr2=0x7f01f413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415e600 0x7f01f413ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 -- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01f4143850 msgr2=0x7f01f40b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01f4143850 0x7f01f40b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 -- 172.21.15.107:0/2629233603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80094b0 con 0x7f01f415d9d0 2024-05-08T21:00:01.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f3fff700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 0x7f01f40b0590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001eb0 tx=0x7f01e000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0005d90 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00070d0 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f414a830 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0007440 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.201+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f414adf0 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.205+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f414b310 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.205+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01e00075a0 con 0x7f01f415d9d0 2024-05-08T21:00:01.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.205+0000 7f01f17fa700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f01d8066730 0x7f01d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.205+0000 7f01f88b1700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f01d8066730 0x7f01d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.205+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f01e0083430 con 0x7f01f415d9d0 2024-05-08T21:00:01.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.205+0000 7f01f88b1700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f01d8066730 0x7f01d8068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009bd0 tx=0x7f01e8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.209+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f01f414b310 con 0x7f01f415d9d0 2024-05-08T21:00:01.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.377+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01f414b310 con 0x7f01f415d9d0 2024-05-08T21:00:01.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f17fa700 1 -- 172.21.15.107:0/2629233603 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01f414b310 con 0x7f01f415d9d0 2024-05-08T21:00:01.387 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:01.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f01d8066730 msgr2=0x7f01d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f01d8066730 0x7f01d8068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009bd0 tx=0x7f01e8008030 comp rx=0 tx=0).stop 2024-05-08T21:00:01.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 msgr2=0x7f01f40b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 0x7f01f40b0590 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f01e0001eb0 tx=0x7f01e000c7b0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 shutdown_connections 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f01d8066730 0x7f01d8068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f01f415e600 0x7f01f413ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f01f415d9d0 0x7f01f40b0590 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 --2- 172.21.15.107:0/2629233603 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f01f4143850 0x7f01f40b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 >> 172.21.15.107:0/2629233603 conn(0x7f01f40b1c70 msgr2=0x7f01f40ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 shutdown_connections 2024-05-08T21:00:01.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.381+0000 7f01f98b3700 1 -- 172.21.15.107:0/2629233603 wait complete. 2024-05-08T21:00:01.401 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:01.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.513+0000 7fd65b009700 1 Processor -- start 2024-05-08T21:00:01.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.513+0000 7fd65b009700 1 -- start start 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd65406aa70 0x7fd6540b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6540aed90 0x7fd65406d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd654161940 con 0x7fd65415cfa0 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540af1b0 con 0x7fd65406aa70 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654160d30 con 0x7fd6540aed90 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659806700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd65406aa70 0x7fd6540b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65a007700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd65415cfa0 0x7fd65406a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36016/0 (socket says 172.21.15.107:36016) 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65a007700 1 -- 172.21.15.107:0/3503309057 learned_addr learned my addr 172.21.15.107:0/3503309057 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:01.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65a808700 1 --2- 172.21.15.107:0/3503309057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6540aed90 0x7fd65406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659005700 1 -- 172.21.15.107:0/3503309057 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291775385 0 0) 0x7fd654161940 con 0x7fd65415cfa0 2024-05-08T21:00:01.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659005700 1 -- 172.21.15.107:0/3503309057 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6400035d0 con 0x7fd65415cfa0 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659806700 1 -- 172.21.15.107:0/3503309057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6540aed90 msgr2=0x7fd65406d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659806700 1 --2- 172.21.15.107:0/3503309057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6540aed90 0x7fd65406d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659806700 1 -- 172.21.15.107:0/3503309057 >> v1:172.21.15.107:6789/0 conn(0x7fd65415cfa0 legacy=0x7fd65406a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659806700 1 -- 172.21.15.107:0/3503309057 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654161010 con 0x7fd65406aa70 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659806700 1 --2- 172.21.15.107:0/3503309057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65406aa70 0x7fd6540b2e40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd648009850 tx=0x7fd648009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70818f6651d6a2c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659005700 1 -- 172.21.15.107:0/3503309057 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011830 con 0x7fd65406aa70 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659005700 1 -- 172.21.15.107:0/3503309057 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd648011990 con 0x7fd65406aa70 2024-05-08T21:00:01.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd659005700 1 -- 172.21.15.107:0/3503309057 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011d00 con 0x7fd65406aa70 2024-05-08T21:00:01.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- 172.21.15.107:0/3503309057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65406aa70 msgr2=0x7fd6540b2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 --2- 172.21.15.107:0/3503309057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65406aa70 0x7fd6540b2e40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd648009850 tx=0x7fd648009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:01.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- 172.21.15.107:0/3503309057 shutdown_connections 2024-05-08T21:00:01.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 --2- 172.21.15.107:0/3503309057 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd6540aed90 0x7fd65406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 --2- 172.21.15.107:0/3503309057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65406aa70 0x7fd6540b2e40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- 172.21.15.107:0/3503309057 >> 172.21.15.107:0/3503309057 conn(0x7fd65406b470 msgr2=0x7fd65406b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:01.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- 172.21.15.107:0/3503309057 shutdown_connections 2024-05-08T21:00:01.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.517+0000 7fd65b009700 1 -- 172.21.15.107:0/3503309057 wait complete. 2024-05-08T21:00:01.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 Processor -- start 2024-05-08T21:00:01.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 -- start start 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd65406aa70 0x7fd6541f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 0x7fd6540b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd65415cfa0 0x7fd654152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6541f3bd0 con 0x7fd6540aed90 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540b08e0 con 0x7fd65406aa70 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65b009700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540afa50 con 0x7fd65415cfa0 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 0x7fd6540b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 0x7fd6540b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56844/0 (socket says 172.21.15.107:56844) 2024-05-08T21:00:01.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 -- 172.21.15.107:0/1446497468 learned_addr learned my addr 172.21.15.107:0/1446497468 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65a007700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd65406aa70 0x7fd6541f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd65a808700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd65415cfa0 0x7fd654152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 -- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd65415cfa0 msgr2=0x7fd654152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd65415cfa0 0x7fd654152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 -- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd65406aa70 msgr2=0x7fd6541f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd65406aa70 0x7fd6541f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.521+0000 7fd659806700 1 -- 172.21.15.107:0/1446497468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480094b0 con 0x7fd6540aed90 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd659806700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 0x7fd6540b2200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6480090b0 tx=0x7fd648004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648004550 con 0x7fd6540aed90 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64801f070 con 0x7fd6540aed90 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6540afd30 con 0x7fd6540aed90 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648003900 con 0x7fd6540aed90 2024-05-08T21:00:01.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6541570b0 con 0x7fd6540aed90 2024-05-08T21:00:01.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6541572a0 con 0x7fd6540aed90 2024-05-08T21:00:01.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd648003a60 con 0x7fd6540aed90 2024-05-08T21:00:01.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd646ffd700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd638066730 0x7fd638068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fd648021070 con 0x7fd6540aed90 2024-05-08T21:00:01.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.525+0000 7fd65a007700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd638066730 0x7fd638068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.529+0000 7fd65a007700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd638066730 0x7fd638068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd650007fd0 tx=0x7fd650009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.533+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd648052cf0 con 0x7fd6540aed90 2024-05-08T21:00:01.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.705+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6540672a0 con 0x7fd6540aed90 2024-05-08T21:00:01.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.705+0000 7fd646ffd700 1 -- 172.21.15.107:0/1446497468 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6480150a0 con 0x7fd6540aed90 2024-05-08T21:00:01.712 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:01.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.705+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd638066730 msgr2=0x7fd638068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.705+0000 7fd65b009700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd638066730 0x7fd638068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd650007fd0 tx=0x7fd650009040 comp rx=0 tx=0).stop 2024-05-08T21:00:01.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.705+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 msgr2=0x7fd6540b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.705+0000 7fd65b009700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 0x7fd6540b2200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6480090b0 tx=0x7fd648004770 comp rx=0 tx=0).stop 2024-05-08T21:00:01.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 shutdown_connections 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd638066730 0x7fd638068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd65415cfa0 0x7fd654152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd6540aed90 0x7fd6540b2200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 --2- 172.21.15.107:0/1446497468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd65406aa70 0x7fd6541f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 >> 172.21.15.107:0/1446497468 conn(0x7fd65406b470 msgr2=0x7fd65406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 shutdown_connections 2024-05-08T21:00:01.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.709+0000 7fd65b009700 1 -- 172.21.15.107:0/1446497468 wait complete. 2024-05-08T21:00:01.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:01.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 Processor -- start 2024-05-08T21:00:01.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 -- start start 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efe000d1da0 0x7efe000cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe000cfe80 0x7efe000b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000d3d40 con 0x7efe00160920 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000d02d0 con 0x7efe000cfe80 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe0579f700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000d0d00 con 0x7efe000d1da0 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efe04f9e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7efe000cfe80 0x7efe000b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efdfffff700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efe00160920 0x7efe000ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:36018/0 (socket says 172.21.15.107:36018) 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.833+0000 7efdfffff700 1 -- 172.21.15.107:0/4130526156 learned_addr learned my addr 172.21.15.107:0/4130526156 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efdf77fe700 1 --2- 172.21.15.107:0/4130526156 >> v2:172.21.15.195:3300/0 conn(0x7efe000d1da0 0x7efe000cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efdff7fe700 1 -- 172.21.15.107:0/4130526156 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845766770 0 0) 0x7efe000d3d40 con 0x7efe00160920 2024-05-08T21:00:01.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efdff7fe700 1 -- 172.21.15.107:0/4130526156 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdec0035d0 con 0x7efe00160920 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe04f9e700 1 -- 172.21.15.107:0/4130526156 >> v2:172.21.15.195:3300/0 conn(0x7efe000d1da0 msgr2=0x7efe000cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe04f9e700 1 --2- 172.21.15.107:0/4130526156 >> v2:172.21.15.195:3300/0 conn(0x7efe000d1da0 0x7efe000cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe04f9e700 1 -- 172.21.15.107:0/4130526156 >> v1:172.21.15.107:6789/0 conn(0x7efe00160920 legacy=0x7efe000ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe04f9e700 1 -- 172.21.15.107:0/4130526156 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000d0fe0 con 0x7efe000cfe80 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe04f9e700 1 --2- 172.21.15.107:0/4130526156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b5e50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe000b90b0 tx=0x7efdf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9bba9cbf85bc30 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efdff7fe700 1 -- 172.21.15.107:0/4130526156 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800e070 con 0x7efe000cfe80 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efdff7fe700 1 -- 172.21.15.107:0/4130526156 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800bb20 con 0x7efe000cfe80 2024-05-08T21:00:01.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efdff7fe700 1 -- 172.21.15.107:0/4130526156 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8012430 con 0x7efe000cfe80 2024-05-08T21:00:01.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 -- 172.21.15.107:0/4130526156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 msgr2=0x7efe000b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 --2- 172.21.15.107:0/4130526156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b5e50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe000b90b0 tx=0x7efdf800b330 comp rx=0 tx=0).stop 2024-05-08T21:00:01.846 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 -- 172.21.15.107:0/4130526156 shutdown_connections 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 --2- 172.21.15.107:0/4130526156 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b5e50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 --2- 172.21.15.107:0/4130526156 >> v2:172.21.15.195:3300/0 conn(0x7efe000d1da0 0x7efe000cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 -- 172.21.15.107:0/4130526156 >> 172.21.15.107:0/4130526156 conn(0x7efe0009c340 msgr2=0x7efe000d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 -- 172.21.15.107:0/4130526156 shutdown_connections 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 -- 172.21.15.107:0/4130526156 wait complete. 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 Processor -- start 2024-05-08T21:00:01.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.837+0000 7efe0579f700 1 -- start start 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe000d1da0 0x7efe000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe00160920 0x7efe001f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000ccd40 con 0x7efe000cfe80 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000cca60 con 0x7efe000d1da0 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe00146300 con 0x7efe00160920 2024-05-08T21:00:01.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56850/0 (socket says 172.21.15.107:56850) 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 -- 172.21.15.107:0/548522891 learned_addr learned my addr 172.21.15.107:0/548522891 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdf77fe700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe000d1da0 0x7efe000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe04f9e700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe00160920 0x7efe001f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 -- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe00160920 msgr2=0x7efe001f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe00160920 0x7efe001f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 -- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe000d1da0 msgr2=0x7efe000b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe000d1da0 0x7efe000b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 -- 172.21.15.107:0/548522891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf8009a70 con 0x7efe000cfe80 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfffff700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b8530 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c4d0 tx=0x7efdf000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0005d90 con 0x7efe000cfe80 2024-05-08T21:00:01.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf00070d0 con 0x7efe000cfe80 2024-05-08T21:00:01.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe001465e0 con 0x7efe000cfe80 2024-05-08T21:00:01.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0007480 con 0x7efe000cfe80 2024-05-08T21:00:01.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.841+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe001f22a0 con 0x7efe000cfe80 2024-05-08T21:00:01.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.845+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe000684b0 con 0x7efe000cfe80 2024-05-08T21:00:01.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.845+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdf00075e0 con 0x7efe000cfe80 2024-05-08T21:00:01.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.845+0000 7efdfd7fa700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efde0066730 0x7efde0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:01.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.845+0000 7efdf77fe700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efde0066730 0x7efde0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:01.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.845+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7efdf0083790 con 0x7efe000cfe80 2024-05-08T21:00:01.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.845+0000 7efdf77fe700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efde0066730 0x7efde0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efe000c9930 tx=0x7efde8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:01.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:01.853+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7efdf0050990 con 0x7efe000cfe80 2024-05-08T21:00:02.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.001+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe000cf510 con 0x7efe000cfe80 2024-05-08T21:00:02.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efdfd7fa700 1 -- 172.21.15.107:0/548522891 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdf0053fb0 con 0x7efe000cfe80 2024-05-08T21:00:02.011 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efde0066730 msgr2=0x7efde0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efde0066730 0x7efde0068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efe000c9930 tx=0x7efde8009240 comp rx=0 tx=0).stop 2024-05-08T21:00:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 msgr2=0x7efe000b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b8530 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c4d0 tx=0x7efdf000c7e0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 shutdown_connections 2024-05-08T21:00:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7efde0066730 0x7efde0068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efe00160920 0x7efe001f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efe000d1da0 0x7efe000b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 --2- 172.21.15.107:0/548522891 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efe000cfe80 0x7efe000b8530 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 >> 172.21.15.107:0/548522891 conn(0x7efe0009c340 msgr2=0x7efe0006afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:02.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 shutdown_connections 2024-05-08T21:00:02.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.005+0000 7efe0579f700 1 -- 172.21.15.107:0/548522891 wait complete. 2024-05-08T21:00:02.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:02.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 Processor -- start 2024-05-08T21:00:02.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 -- start start 2024-05-08T21:00:02.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f141c0ce990 0x7f141c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:02.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f141c15f770 0x7f141c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:02.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141c15eda0 con 0x7f141c15afa0 2024-05-08T21:00:02.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c15ea70 con 0x7f141c15f770 2024-05-08T21:00:02.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f1420921700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c15ba90 con 0x7f141c0ce990 2024-05-08T21:00:02.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f141c15f770 0x7f141c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:02.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f141c15f770 0x7f141c0b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56856/0 (socket says 172.21.15.107:56856) 2024-05-08T21:00:02.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 -- 172.21.15.107:0/1241465905 learned_addr learned my addr 172.21.15.107:0/1241465905 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:02.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141affd700 1 --2- 172.21.15.107:0/1241465905 >> v2:172.21.15.195:3300/0 conn(0x7f141c0ce990 0x7f141c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:02.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 -- 172.21.15.107:0/1241465905 >> v2:172.21.15.195:3300/0 conn(0x7f141c0ce990 msgr2=0x7f141c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:02.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 --2- 172.21.15.107:0/1241465905 >> v2:172.21.15.195:3300/0 conn(0x7f141c0ce990 0x7f141c15f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 -- 172.21.15.107:0/1241465905 >> v1:172.21.15.195:6789/0 conn(0x7f141c15afa0 legacy=0x7f141c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.137+0000 7f141bfff700 1 -- 172.21.15.107:0/1241465905 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c15bd40 con 0x7f141c15f770 2024-05-08T21:00:02.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f141bfff700 1 --2- 172.21.15.107:0/1241465905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c15f770 0x7f141c0b4270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f141c06df50 tx=0x7f140c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa257919fbd1223d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:02.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f141a7fc700 1 -- 172.21.15.107:0/1241465905 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011830 con 0x7f141c15f770 2024-05-08T21:00:02.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f141a7fc700 1 -- 172.21.15.107:0/1241465905 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c011990 con 0x7f141c15f770 2024-05-08T21:00:02.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f141a7fc700 1 -- 172.21.15.107:0/1241465905 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011d20 con 0x7f141c15f770 2024-05-08T21:00:02.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 -- 172.21.15.107:0/1241465905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c15f770 msgr2=0x7f141c0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 --2- 172.21.15.107:0/1241465905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c15f770 0x7f141c0b4270 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f141c06df50 tx=0x7f140c009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 -- 172.21.15.107:0/1241465905 shutdown_connections 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 --2- 172.21.15.107:0/1241465905 >> v2:172.21.15.195:3300/0 conn(0x7f141c0ce990 0x7f141c15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 --2- 172.21.15.107:0/1241465905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c15f770 0x7f141c0b4270 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 -- 172.21.15.107:0/1241465905 >> 172.21.15.107:0/1241465905 conn(0x7f141c06c330 msgr2=0x7f141c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 -- 172.21.15.107:0/1241465905 shutdown_connections 2024-05-08T21:00:02.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.141+0000 7f1420921700 1 -- 172.21.15.107:0/1241465905 wait complete. 2024-05-08T21:00:02.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 Processor -- start 2024-05-08T21:00:02.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 -- start start 2024-05-08T21:00:02.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 0x7f141c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141c15afa0 0x7f141c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f141c15f770 0x7f141c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c14d710 con 0x7f141c0ce990 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c15d9f0 con 0x7f141c15afa0 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c14d3e0 con 0x7f141c15f770 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 0x7f141c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 0x7f141c0cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56866/0 (socket says 172.21.15.107:56866) 2024-05-08T21:00:02.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 -- 172.21.15.107:0/3483807823 learned_addr learned my addr 172.21.15.107:0/3483807823 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141bfff700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f141c15f770 0x7f141c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141affd700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141c15afa0 0x7f141c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 -- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f141c15f770 msgr2=0x7f141c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f141c15f770 0x7f141c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 -- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141c15afa0 msgr2=0x7f141c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141c15afa0 0x7f141c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 -- 172.21.15.107:0/3483807823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009570 con 0x7f141c0ce990 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f141b7fe700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 0x7f141c0cc950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f141400c500 tx=0x7f141400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140052d0 con 0x7f141c0ce990 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1414005430 con 0x7f141c0ce990 2024-05-08T21:00:02.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c0cce90 con 0x7f141c0ce990 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14140055a0 con 0x7f141c0ce990 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.145+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c15d430 con 0x7f141c0ce990 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.149+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c0684b0 con 0x7f141c0ce990 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.149+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14140038e0 con 0x7f141c0ce990 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.149+0000 7f1413fff700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13fc066730 0x7f13fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.149+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f14140839d0 con 0x7f141c0ce990 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.149+0000 7f141affd700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13fc066730 0x7f13fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:02.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.149+0000 7f141affd700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13fc066730 0x7f13fc068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f141c166de0 tx=0x7f140400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:02.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.157+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1414050c50 con 0x7f141c0ce990 2024-05-08T21:00:02.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.336+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f141c06e220 con 0x7f141c0ce990 2024-05-08T21:00:02.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.336+0000 7f1413fff700 1 -- 172.21.15.107:0/3483807823 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1414054270 con 0x7f141c0ce990 2024-05-08T21:00:02.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13fc066730 msgr2=0x7f13fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13fc066730 0x7f13fc068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f141c166de0 tx=0x7f140400b040 comp rx=0 tx=0).stop 2024-05-08T21:00:02.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 msgr2=0x7f141c0cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:02.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 0x7f141c0cc950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f141400c500 tx=0x7f141400c8c0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 shutdown_connections 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f13fc066730 0x7f13fc068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f141c15f770 0x7f141c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f141c15afa0 0x7f141c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 --2- 172.21.15.107:0/3483807823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c0ce990 0x7f141c0cc950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 >> 172.21.15.107:0/3483807823 conn(0x7f141c06c330 msgr2=0x7f141c06cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 shutdown_connections 2024-05-08T21:00:02.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:02.340+0000 7f1420921700 1 -- 172.21.15.107:0/3483807823 wait complete. 2024-05-08T21:00:02.349 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:02.360 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2024-05-08T21:00:02.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:02.360 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T21:00:02.386 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi107.stderr:ceph-fuse[33670]: fuse finished with error 0 and tester_r 0 2024-05-08T21:00:02.388 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:00:08.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:00:08.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:08.491 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T21:00:08.506 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T21:00:08.506 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:08.558 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T21:00:08.558 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:08.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:08.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 Processor -- start 2024-05-08T21:00:08.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 -- start start 2024-05-08T21:00:08.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f59300b3c20 0x7f59301624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:08.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5930070110 0x7f59300705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:08.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5930158960 con 0x7f5930071e70 2024-05-08T21:00:08.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300b1f60 con 0x7f59300b3c20 2024-05-08T21:00:08.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5935d10700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59300ae990 con 0x7f5930070110 2024-05-08T21:00:08.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5934d0e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f59300b3c20 0x7f59301624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:08.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5934d0e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f59300b3c20 0x7f59301624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37244/0 (socket says 172.21.15.107:37244) 2024-05-08T21:00:08.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5934d0e700 1 -- 172.21.15.107:0/371816061 learned_addr learned my addr 172.21.15.107:0/371816061 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f593550f700 1 --2- 172.21.15.107:0/371816061 >> v2:172.21.15.195:3300/0 conn(0x7f5930070110 0x7f59300705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.676+0000 7f5934d0e700 1 -- 172.21.15.107:0/371816061 >> v2:172.21.15.195:3300/0 conn(0x7f5930070110 msgr2=0x7f59300705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5934d0e700 1 --2- 172.21.15.107:0/371816061 >> v2:172.21.15.195:3300/0 conn(0x7f5930070110 0x7f59300705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5934d0e700 1 -- 172.21.15.107:0/371816061 >> v1:172.21.15.195:6789/0 conn(0x7f5930071e70 legacy=0x7f59300b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5934d0e700 1 -- 172.21.15.107:0/371816061 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300b2170 con 0x7f59300b3c20 2024-05-08T21:00:08.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5934d0e700 1 --2- 172.21.15.107:0/371816061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59300b3c20 0x7f59301624b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f59300b51f0 tx=0x7f5920009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a94f534689b50b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:08.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f592f7fe700 1 -- 172.21.15.107:0/371816061 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011830 con 0x7f59300b3c20 2024-05-08T21:00:08.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f592f7fe700 1 -- 172.21.15.107:0/371816061 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920011990 con 0x7f59300b3c20 2024-05-08T21:00:08.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f592f7fe700 1 -- 172.21.15.107:0/371816061 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011d20 con 0x7f59300b3c20 2024-05-08T21:00:08.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 -- 172.21.15.107:0/371816061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59300b3c20 msgr2=0x7f59301624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:08.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 --2- 172.21.15.107:0/371816061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59300b3c20 0x7f59301624b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f59300b51f0 tx=0x7f5920009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 -- 172.21.15.107:0/371816061 shutdown_connections 2024-05-08T21:00:08.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 --2- 172.21.15.107:0/371816061 >> v2:172.21.15.195:3300/0 conn(0x7f5930070110 0x7f59300705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 --2- 172.21.15.107:0/371816061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f59300b3c20 0x7f59301624b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 -- 172.21.15.107:0/371816061 >> 172.21.15.107:0/371816061 conn(0x7f593006c330 msgr2=0x7f593006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:08.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 -- 172.21.15.107:0/371816061 shutdown_connections 2024-05-08T21:00:08.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 -- 172.21.15.107:0/371816061 wait complete. 2024-05-08T21:00:08.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 Processor -- start 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.680+0000 7f5935d10700 1 -- start start 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 0x7f59300afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5930071e70 0x7f593014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59300b3c20 0x7f593014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593014f970 con 0x7f5930070110 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593014ed60 con 0x7f59300b3c20 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593014f040 con 0x7f5930071e70 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 0x7f59300afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 0x7f59300afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37252/0 (socket says 172.21.15.107:37252) 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 -- 172.21.15.107:0/504901963 learned_addr learned my addr 172.21.15.107:0/504901963 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f592ffff700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5930071e70 0x7f593014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:08.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f593550f700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59300b3c20 0x7f593014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 -- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5930071e70 msgr2=0x7f593014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5930071e70 0x7f593014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 -- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59300b3c20 msgr2=0x7f593014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59300b3c20 0x7f593014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 -- 172.21.15.107:0/504901963 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009570 con 0x7f5930070110 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f592ffff700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5930071e70 0x7f593014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5934d0e700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 0x7f59300afec0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5920000c00 tx=0x7f5920004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920004610 con 0x7f5930070110 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592001e070 con 0x7f5930070110 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593014f320 con 0x7f5930070110 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200038e0 con 0x7f5930070110 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59300b0400 con 0x7f5930070110 2024-05-08T21:00:08.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.684+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59300b0650 con 0x7f5930070110 2024-05-08T21:00:08.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.688+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5920003a40 con 0x7f5930070110 2024-05-08T21:00:08.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.688+0000 7f592d7fa700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5910066760 0x7f5910068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:08.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.688+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f5920084d20 con 0x7f5930070110 2024-05-08T21:00:08.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.688+0000 7f592ffff700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5910066760 0x7f5910068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:08.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.688+0000 7f592ffff700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5910066760 0x7f5910068c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f593006e260 tx=0x7f5918009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:08.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.696+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5920052170 con 0x7f5930070110 2024-05-08T21:00:08.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.868+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59300684b0 con 0x7f5930070110 2024-05-08T21:00:08.878 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.868+0000 7f592d7fa700 1 -- 172.21.15.107:0/504901963 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f5920020090 con 0x7f5930070110 2024-05-08T21:00:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:08.879 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5910066760 msgr2=0x7f5910068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5910066760 0x7f5910068c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f593006e260 tx=0x7f5918009040 comp rx=0 tx=0).stop 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 msgr2=0x7f59300afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 0x7f59300afec0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5920000c00 tx=0x7f5920004770 comp rx=0 tx=0).stop 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 shutdown_connections 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59300b3c20 0x7f593014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5910066760 0x7f5910068c20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5930071e70 0x7f593014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 --2- 172.21.15.107:0/504901963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5930070110 0x7f59300afec0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:08.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 >> 172.21.15.107:0/504901963 conn(0x7f593006c330 msgr2=0x7f59300cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:08.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 shutdown_connections 2024-05-08T21:00:08.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:08.872+0000 7f5935d10700 1 -- 172.21.15.107:0/504901963 wait complete. 2024-05-08T21:00:08.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:08.894 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:09.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 Processor -- start 2024-05-08T21:00:09.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 -- start start 2024-05-08T21:00:09.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb33c0d01c0 0x7fb33c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c0d3d40 0x7fb33c0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33c0cf480 con 0x7fb33c160ce0 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c0ce890 con 0x7fb33c0d3d40 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb341d2b700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb33c0ceb50 con 0x7fb33c0d01c0 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c0d3d40 0x7fb33c0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb33c0d3d40 0x7fb33c0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37268/0 (socket says 172.21.15.107:37268) 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 -- 172.21.15.107:0/723436047 learned_addr learned my addr 172.21.15.107:0/723436047 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 -- 172.21.15.107:0/723436047 >> v2:172.21.15.195:3300/0 conn(0x7fb33c0d01c0 msgr2=0x7fb33c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33affd700 1 --2- 172.21.15.107:0/723436047 >> v2:172.21.15.195:3300/0 conn(0x7fb33c0d01c0 0x7fb33c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 --2- 172.21.15.107:0/723436047 >> v2:172.21.15.195:3300/0 conn(0x7fb33c0d01c0 0x7fb33c0b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 -- 172.21.15.107:0/723436047 >> v1:172.21.15.195:6789/0 conn(0x7fb33c160ce0 legacy=0x7fb33c0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 -- 172.21.15.107:0/723436047 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c0cee30 con 0x7fb33c0d3d40 2024-05-08T21:00:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33bfff700 1 --2- 172.21.15.107:0/723436047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0b2dd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb33c08cd70 tx=0x7fb33400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44e5412b3accca2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33a7fc700 1 -- 172.21.15.107:0/723436047 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33400e070 con 0x7fb33c0d3d40 2024-05-08T21:00:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33a7fc700 1 -- 172.21.15.107:0/723436047 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33400b9c0 con 0x7fb33c0d3d40 2024-05-08T21:00:09.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.008+0000 7fb33a7fc700 1 -- 172.21.15.107:0/723436047 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33400bd70 con 0x7fb33c0d3d40 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- 172.21.15.107:0/723436047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d3d40 msgr2=0x7fb33c0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 --2- 172.21.15.107:0/723436047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0b2dd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb33c08cd70 tx=0x7fb33400b330 comp rx=0 tx=0).stop 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- 172.21.15.107:0/723436047 shutdown_connections 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 --2- 172.21.15.107:0/723436047 >> v2:172.21.15.195:3300/0 conn(0x7fb33c0d01c0 0x7fb33c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 --2- 172.21.15.107:0/723436047 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0b2dd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- 172.21.15.107:0/723436047 >> 172.21.15.107:0/723436047 conn(0x7fb33c09c4c0 msgr2=0x7fb33c0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- 172.21.15.107:0/723436047 shutdown_connections 2024-05-08T21:00:09.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- 172.21.15.107:0/723436047 wait complete. 2024-05-08T21:00:09.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 Processor -- start 2024-05-08T21:00:09.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- start start 2024-05-08T21:00:09.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 0x7fb33c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33c160ce0 0x7fb33c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c150190 con 0x7fb33c0d01c0 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0b7740 con 0x7fb33c0d3d40 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.012+0000 7fb341d2b700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c0b7410 con 0x7fb33c160ce0 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 0x7fb33c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 0x7fb33c14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37282/0 (socket says 172.21.15.107:37282) 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 -- 172.21.15.107:0/4015205065 learned_addr learned my addr 172.21.15.107:0/4015205065 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33bfff700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33c160ce0 0x7fb33c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33affd700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 -- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33c160ce0 msgr2=0x7fb33c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33c160ce0 0x7fb33c0ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 -- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33c0d3d40 msgr2=0x7fb33c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 -- 172.21.15.107:0/4015205065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334009b30 con 0x7fb33c0d01c0 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33b7fe700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 0x7fb33c14d6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c500 tx=0x7fb33000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300052d0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330005430 con 0x7fb33c0d01c0 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300055a0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33c14dd80 con 0x7fb33c0d01c0 2024-05-08T21:00:09.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33c0cd240 con 0x7fb33c0d01c0 2024-05-08T21:00:09.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb33c0b48e0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3300038e0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb323fff700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb328066730 0x7fb328068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb33affd700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb328066730 0x7fb328068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.016+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fb3300836d0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.020+0000 7fb33affd700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb328066730 0x7fb328068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb33c1f68b0 tx=0x7fb32c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.028+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb33c0b48e0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.192+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb33c0b48e0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.192+0000 7fb323fff700 1 -- 172.21.15.107:0/4015205065 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb33c0b48e0 con 0x7fb33c0d01c0 2024-05-08T21:00:09.204 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:09.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb328066730 msgr2=0x7fb328068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb328066730 0x7fb328068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb33c1f68b0 tx=0x7fb32c008040 comp rx=0 tx=0).stop 2024-05-08T21:00:09.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 msgr2=0x7fb33c14d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 0x7fb33c14d6d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c500 tx=0x7fb33000c8c0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 shutdown_connections 2024-05-08T21:00:09.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb328066730 0x7fb328068bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb33c160ce0 0x7fb33c0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb33c0d3d40 0x7fb33c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 --2- 172.21.15.107:0/4015205065 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb33c0d01c0 0x7fb33c14d6d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 >> 172.21.15.107:0/4015205065 conn(0x7fb33c09c4c0 msgr2=0x7fb33c15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 shutdown_connections 2024-05-08T21:00:09.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.196+0000 7fb341d2b700 1 -- 172.21.15.107:0/4015205065 wait complete. 2024-05-08T21:00:09.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:09.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 Processor -- start 2024-05-08T21:00:09.339 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 -- start start 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbe14160a30 0x7fbe140d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe140d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbe140d1cc0 0x7fbe140cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140b66d0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140d2170 con 0x7fbe14160a30 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe18c93700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140d11c0 con 0x7fbe140d3c50 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbe140d1cc0 0x7fbe140cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbe140d1cc0 0x7fbe140cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37292/0 (socket says 172.21.15.107:37292) 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe11d9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe140d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe1259c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbe14160a30 0x7fbe140d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 -- 172.21.15.107:0/3941370426 learned_addr learned my addr 172.21.15.107:0/3941370426 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 -- 172.21.15.107:0/3941370426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 msgr2=0x7fbe140d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 --2- 172.21.15.107:0/3941370426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe140d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 -- 172.21.15.107:0/3941370426 >> v2:172.21.15.195:3300/0 conn(0x7fbe14160a30 msgr2=0x7fbe140d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 --2- 172.21.15.107:0/3941370426 >> v2:172.21.15.195:3300/0 conn(0x7fbe14160a30 0x7fbe140d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 -- 172.21.15.107:0/3941370426 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140d14a0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe1259c700 1 --2- 172.21.15.107:0/3941370426 >> v2:172.21.15.195:3300/0 conn(0x7fbe14160a30 0x7fbe140d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:09.343 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe12d9d700 1 --2- 172.21.15.107:0/3941370426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140cddd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbe140d0db0 tx=0x7fbe0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4091f7135ba16d52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe1159a700 1 -- 172.21.15.107:0/3941370426 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00e070 con 0x7fbe140d1cc0 2024-05-08T21:00:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe1159a700 1 -- 172.21.15.107:0/3941370426 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c00b910 con 0x7fbe140d1cc0 2024-05-08T21:00:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.332+0000 7fbe1159a700 1 -- 172.21.15.107:0/3941370426 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00bcc0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- 172.21.15.107:0/3941370426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 msgr2=0x7fbe140cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- 172.21.15.107:0/3941370426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140cddd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbe140d0db0 tx=0x7fbe0c00b330 comp rx=0 tx=0).stop 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- 172.21.15.107:0/3941370426 shutdown_connections 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- 172.21.15.107:0/3941370426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140cddd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- 172.21.15.107:0/3941370426 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe140d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- 172.21.15.107:0/3941370426 >> v2:172.21.15.195:3300/0 conn(0x7fbe14160a30 0x7fbe140d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- 172.21.15.107:0/3941370426 >> 172.21.15.107:0/3941370426 conn(0x7fbe1409c500 msgr2=0x7fbe140d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- 172.21.15.107:0/3941370426 shutdown_connections 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- 172.21.15.107:0/3941370426 wait complete. 2024-05-08T21:00:09.345 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 Processor -- start 2024-05-08T21:00:09.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- start start 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe1414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe14160a30 0x7fbe1414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1414b7b0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1414b510 con 0x7fbe14160a30 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.336+0000 7fbe18c93700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140c9f10 con 0x7fbe140d3c50 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37302/0 (socket says 172.21.15.107:37302) 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 -- 172.21.15.107:0/1299837660 learned_addr learned my addr 172.21.15.107:0/1299837660 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe11d9b700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe1414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe12d9d700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe14160a30 0x7fbe1414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 -- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 msgr2=0x7fbe1414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe1414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 -- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe14160a30 msgr2=0x7fbe1414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe14160a30 0x7fbe1414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 -- 172.21.15.107:0/1299837660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040094b0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe1259c700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140c9910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400ebe0 tx=0x7fbe0400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04009770 con 0x7fbe140d1cc0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0400c850 con 0x7fbe140d1cc0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0400cbe0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c009b30 con 0x7fbe140d1cc0 2024-05-08T21:00:09.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1414bca0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.340+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe140684b0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.344+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe0400cd40 con 0x7fbe140d1cc0 2024-05-08T21:00:09.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.344+0000 7fbe0affd700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbdf4066760 0x7fbdf4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.344+0000 7fbe11d9b700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbdf4066760 0x7fbdf4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.344+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fbe040841d0 con 0x7fbe140d1cc0 2024-05-08T21:00:09.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.344+0000 7fbe11d9b700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbdf4066760 0x7fbdf4068c20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe1406bfe0 tx=0x7fbdfc009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.348+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbe04051470 con 0x7fbe140d1cc0 2024-05-08T21:00:09.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.524+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe140b6b60 con 0x7fbe140d1cc0 2024-05-08T21:00:09.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.524+0000 7fbe0affd700 1 -- 172.21.15.107:0/1299837660 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe04054a90 con 0x7fbe140d1cc0 2024-05-08T21:00:09.534 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbdf4066760 msgr2=0x7fbdf4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbdf4066760 0x7fbdf4068c20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe1406bfe0 tx=0x7fbdfc009240 comp rx=0 tx=0).stop 2024-05-08T21:00:09.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 msgr2=0x7fbe140c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140c9910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400ebe0 tx=0x7fbe0400eef0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 shutdown_connections 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe14160a30 0x7fbe1414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbdf4066760 0x7fbdf4068c20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbe140d3c50 0x7fbe1414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 --2- 172.21.15.107:0/1299837660 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbe140d1cc0 0x7fbe140c9910 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 >> 172.21.15.107:0/1299837660 conn(0x7fbe1409c500 msgr2=0x7fbe1415f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 shutdown_connections 2024-05-08T21:00:09.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.528+0000 7fbe18c93700 1 -- 172.21.15.107:0/1299837660 wait complete. 2024-05-08T21:00:09.549 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6027e8700 1 Processor -- start 2024-05-08T21:00:09.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6027e8700 1 -- start start 2024-05-08T21:00:09.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6027e8700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0d1910 0x7fc5fc0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6027e8700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc06c620 con 0x7fc5fc15d330 2024-05-08T21:00:09.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6027e8700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5fc06c900 con 0x7fc5fc0b5ee0 2024-05-08T21:00:09.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6027e8700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc0ca290 con 0x7fc5fc0d1910 2024-05-08T21:00:09.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6017e6700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc5fc15d330 0x7fc5fc0b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39490/0 (socket says 172.21.15.107:39490) 2024-05-08T21:00:09.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc6017e6700 1 -- 172.21.15.107:0/4145171162 learned_addr learned my addr 172.21.15.107:0/4145171162 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.656+0000 7fc601fe7700 1 --2- 172.21.15.107:0/4145171162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0d1910 0x7fc5fc0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650408017 0 0) 0x7fc5fc06c620 con 0x7fc5fc15d330 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e80035d0 con 0x7fc5fc15d330 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463960357 0 0) 0x7fc5fc06c900 con 0x7fc5fc0b5ee0 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc06c620 con 0x7fc5fc0b5ee0 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc601fe7700 1 -- 172.21.15.107:0/4145171162 >> v1:172.21.15.195:6789/0 conn(0x7fc5fc0b5ee0 legacy=0x7fc5fc0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc601fe7700 1 -- 172.21.15.107:0/4145171162 >> v1:172.21.15.107:6789/0 conn(0x7fc5fc15d330 legacy=0x7fc5fc0b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc601fe7700 1 -- 172.21.15.107:0/4145171162 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc0ca570 con 0x7fc5fc0d1910 2024-05-08T21:00:09.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc601fe7700 1 --2- 172.21.15.107:0/4145171162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0d1910 0x7fc5fc0cb1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009dc0 tx=0x7fc5f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a95ccdbff21f746a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400e070 con 0x7fc5fc0d1910 2024-05-08T21:00:09.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f400bb20 con 0x7fc5fc0d1910 2024-05-08T21:00:09.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc5f3fff700 1 -- 172.21.15.107:0/4145171162 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400be90 con 0x7fc5fc0d1910 2024-05-08T21:00:09.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 -- 172.21.15.107:0/4145171162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0d1910 msgr2=0x7fc5fc0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 --2- 172.21.15.107:0/4145171162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0d1910 0x7fc5fc0cb1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009dc0 tx=0x7fc5f400b330 comp rx=0 tx=0).stop 2024-05-08T21:00:09.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 -- 172.21.15.107:0/4145171162 shutdown_connections 2024-05-08T21:00:09.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 --2- 172.21.15.107:0/4145171162 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0d1910 0x7fc5fc0cb1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 -- 172.21.15.107:0/4145171162 >> 172.21.15.107:0/4145171162 conn(0x7fc5fc0d0df0 msgr2=0x7fc5fc0d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 -- 172.21.15.107:0/4145171162 shutdown_connections 2024-05-08T21:00:09.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.660+0000 7fc6027e8700 1 -- 172.21.15.107:0/4145171162 wait complete. 2024-05-08T21:00:09.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 Processor -- start 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 -- start start 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0b5ee0 0x7fc5fc15ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 0x7fc5fc15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5fc15d330 0x7fc5fc1f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc15e710 con 0x7fc5fc0d1910 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc15db40 con 0x7fc5fc15d330 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc6027e8700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc15dde0 con 0x7fc5fc0b5ee0 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.664+0000 7fc600fe5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 0x7fc5fc15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 0x7fc5fc15eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37318/0 (socket says 172.21.15.107:37318) 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 -- 172.21.15.107:0/2993912161 learned_addr learned my addr 172.21.15.107:0/2993912161 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc6017e6700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0b5ee0 0x7fc5fc15ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc601fe7700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5fc15d330 0x7fc5fc1f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 -- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0b5ee0 msgr2=0x7fc5fc15ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0b5ee0 0x7fc5fc15ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 -- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5fc15d330 msgr2=0x7fc5fc1f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5fc15d330 0x7fc5fc1f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 -- 172.21.15.107:0/2993912161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4009a70 con 0x7fc5fc0d1910 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc600fe5700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 0x7fc5fc15eba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c500 tx=0x7fc5f800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80052d0 con 0x7fc5fc0d1910 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc15e0c0 con 0x7fc5fc0d1910 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f8005450 con 0x7fc5fc0d1910 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc157180 con 0x7fc5fc0d1910 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80038a0 con 0x7fc5fc0d1910 2024-05-08T21:00:09.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc15e880 con 0x7fc5fc0d1910 2024-05-08T21:00:09.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.668+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc5f8003a00 con 0x7fc5fc0d1910 2024-05-08T21:00:09.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.672+0000 7fc5f1ffb700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc5e0066760 0x7fc5e0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.672+0000 7fc6017e6700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc5e0066760 0x7fc5e0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.672+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fc5f8083410 con 0x7fc5fc0d1910 2024-05-08T21:00:09.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.672+0000 7fc6017e6700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc5e0066760 0x7fc5e0068c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec007fd0 tx=0x7fc5ec007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.680+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fc5f80506e0 con 0x7fc5fc0d1910 2024-05-08T21:00:09.858 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.848+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5fc0684b0 con 0x7fc5fc0d1910 2024-05-08T21:00:09.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc5f1ffb700 1 -- 172.21.15.107:0/2993912161 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5f8003cb0 con 0x7fc5fc0d1910 2024-05-08T21:00:09.859 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc5e0066760 msgr2=0x7fc5e0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc5e0066760 0x7fc5e0068c20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec007fd0 tx=0x7fc5ec007de0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 msgr2=0x7fc5fc15eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 0x7fc5fc15eba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c500 tx=0x7fc5f800c810 comp rx=0 tx=0).stop 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 shutdown_connections 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5fc15d330 0x7fc5fc1f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc5fc0d1910 0x7fc5fc15eba0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc5e0066760 0x7fc5e0068c20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 --2- 172.21.15.107:0/2993912161 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc5fc0b5ee0 0x7fc5fc15ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 >> 172.21.15.107:0/2993912161 conn(0x7fc5fc0d0df0 msgr2=0x7fc5fc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 shutdown_connections 2024-05-08T21:00:09.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.852+0000 7fc6027e8700 1 -- 172.21.15.107:0/2993912161 wait complete. 2024-05-08T21:00:09.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:09.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.980+0000 7f39918bb700 1 Processor -- start 2024-05-08T21:00:09.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.980+0000 7f39918bb700 1 -- start start 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f398c0d1690 0x7f398c0d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f398c0d0f20 0x7f398c0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0d1fb0 con 0x7f398c0cf6e0 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0d3e50 con 0x7f398c0d1690 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0ce870 con 0x7f398c0d0f20 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f398c0d1690 0x7f398c0d37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f398c0d1690 0x7f398c0d37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37324/0 (socket says 172.21.15.107:37324) 2024-05-08T21:00:09.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 -- 172.21.15.107:0/2286011966 learned_addr learned my addr 172.21.15.107:0/2286011966 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f398bfff700 1 --2- 172.21.15.107:0/2286011966 >> v2:172.21.15.195:3300/0 conn(0x7f398c0d0f20 0x7f398c0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 -- 172.21.15.107:0/2286011966 >> v2:172.21.15.195:3300/0 conn(0x7f398c0d0f20 msgr2=0x7f398c0d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 --2- 172.21.15.107:0/2286011966 >> v2:172.21.15.195:3300/0 conn(0x7f398c0d0f20 0x7f398c0d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 -- 172.21.15.107:0/2286011966 >> v1:172.21.15.195:6789/0 conn(0x7f398c0cf6e0 legacy=0x7f398c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 -- 172.21.15.107:0/2286011966 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0ceb50 con 0x7f398c0d1690 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39908b9700 1 --2- 172.21.15.107:0/2286011966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0d1690 0x7f398c0d37c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f398c08d360 tx=0x7f3974009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2e25c000aa87e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f398b7fe700 1 -- 172.21.15.107:0/2286011966 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974011830 con 0x7f398c0d1690 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f398b7fe700 1 -- 172.21.15.107:0/2286011966 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974011990 con 0x7f398c0d1690 2024-05-08T21:00:09.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f398b7fe700 1 -- 172.21.15.107:0/2286011966 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974011d20 con 0x7f398c0d1690 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- 172.21.15.107:0/2286011966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0d1690 msgr2=0x7f398c0d37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 --2- 172.21.15.107:0/2286011966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0d1690 0x7f398c0d37c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f398c08d360 tx=0x7f3974009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- 172.21.15.107:0/2286011966 shutdown_connections 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 --2- 172.21.15.107:0/2286011966 >> v2:172.21.15.195:3300/0 conn(0x7f398c0d0f20 0x7f398c0d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 --2- 172.21.15.107:0/2286011966 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0d1690 0x7f398c0d37c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- 172.21.15.107:0/2286011966 >> 172.21.15.107:0/2286011966 conn(0x7f398c09c3c0 msgr2=0x7f398c0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- 172.21.15.107:0/2286011966 shutdown_connections 2024-05-08T21:00:09.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.984+0000 7f39918bb700 1 -- 172.21.15.107:0/2286011966 wait complete. 2024-05-08T21:00:09.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 Processor -- start 2024-05-08T21:00:09.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 -- start start 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f398c0cf6e0 0x7f398c0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f398c0d0f20 0x7f398c15a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 0x7f398c15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1f2b80 con 0x7f398c0cab70 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0ca880 con 0x7f398c0cf6e0 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39918bb700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1f3680 con 0x7f398c0d0f20 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 0x7f398c15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f398bfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f398c0d0f20 0x7f398c15a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f398bfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f398c0d0f20 0x7f398c15a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41200/0 (socket says 172.21.15.107:41200) 2024-05-08T21:00:09.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f398bfff700 1 -- 172.21.15.107:0/3479735878 learned_addr learned my addr 172.21.15.107:0/3479735878 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39908b9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f398c0cf6e0 0x7f398c0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 0x7f398c15fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37332/0 (socket says 172.21.15.107:37332) 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 -- 172.21.15.107:0/3479735878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f398c0d0f20 msgr2=0x7f398c15a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f398c0d0f20 0x7f398c15a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 -- 172.21.15.107:0/3479735878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f398c0cf6e0 msgr2=0x7f398c0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f398c0cf6e0 0x7f398c0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:09.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 -- 172.21.15.107:0/3479735878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974009570 con 0x7f398c0cab70 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39910ba700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 0x7f398c15fc20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f398400cb10 tx=0x7f398400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.988+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984003c20 con 0x7f398c0cab70 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984003d80 con 0x7f398c0cab70 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398400a980 con 0x7f398c0cab70 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c0cd490 con 0x7f398c0cab70 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c1f3b10 con 0x7f398c0cab70 2024-05-08T21:00:10.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c0684b0 con 0x7f398c0cab70 2024-05-08T21:00:10.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f398400aae0 con 0x7f398c0cab70 2024-05-08T21:00:10.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39897fa700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f396c066730 0x7f396c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39908b9700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f396c066730 0x7f396c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.992+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f3984083fb0 con 0x7f398c0cab70 2024-05-08T21:00:10.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:09.996+0000 7f39908b9700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f396c066730 0x7f396c068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f398c06a730 tx=0x7f3974008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.004+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f39840b5cf0 con 0x7f398c0cab70 2024-05-08T21:00:10.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.188+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f398c1f37c0 con 0x7f398c0cab70 2024-05-08T21:00:10.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.188+0000 7f39897fa700 1 -- 172.21.15.107:0/3479735878 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3984051250 con 0x7f398c0cab70 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f396c066730 msgr2=0x7f396c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f396c066730 0x7f396c068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f398c06a730 tx=0x7f3974008030 comp rx=0 tx=0).stop 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 msgr2=0x7f398c15fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 0x7f398c15fc20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f398400cb10 tx=0x7f398400ce20 comp rx=0 tx=0).stop 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 shutdown_connections 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f398c0cab70 0x7f398c15fc20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f396c066730 0x7f396c068bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f398c0d0f20 0x7f398c15a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 --2- 172.21.15.107:0/3479735878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f398c0cf6e0 0x7f398c0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 >> 172.21.15.107:0/3479735878 conn(0x7f398c09c3c0 msgr2=0x7f398c0b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:10.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 shutdown_connections 2024-05-08T21:00:10.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.192+0000 7f39918bb700 1 -- 172.21.15.107:0/3479735878 wait complete. 2024-05-08T21:00:10.202 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:10.213 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-08T21:00:10.213 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:10.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:10.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f58514bf700 1 Processor -- start 2024-05-08T21:00:10.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f58514bf700 1 -- start start 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f58514bf700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c15a8b0 0x7f584c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f58514bf700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0b2b50 con 0x7f584c06ba80 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f58514bf700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0ce2d0 con 0x7f584c159dc0 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f58514bf700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c15b430 con 0x7f584c15a8b0 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f5843fff700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f584c06ba80 0x7f584c15a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39506/0 (socket says 172.21.15.107:39506) 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f5843fff700 1 -- 172.21.15.107:0/2379221642 learned_addr learned my addr 172.21.15.107:0/2379221642 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:10.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f5850cbe700 1 --2- 172.21.15.107:0/2379221642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c15a8b0 0x7f584c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710391034 0 0) 0x7f584c0b2b50 con 0x7f584c06ba80 2024-05-08T21:00:10.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58380035d0 con 0x7f584c06ba80 2024-05-08T21:00:10.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740080431 0 0) 0x7f584c0ce2d0 con 0x7f584c159dc0 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.376+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f584c0b2b50 con 0x7f584c159dc0 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f5850cbe700 1 -- 172.21.15.107:0/2379221642 >> v1:172.21.15.195:6789/0 conn(0x7f584c159dc0 legacy=0x7f584c06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f5850cbe700 1 -- 172.21.15.107:0/2379221642 >> v1:172.21.15.107:6789/0 conn(0x7f584c06ba80 legacy=0x7f584c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f5850cbe700 1 -- 172.21.15.107:0/2379221642 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0cdd20 con 0x7f584c15a8b0 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f5850cbe700 1 --2- 172.21.15.107:0/2379221642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c15a8b0 0x7f584c0b2610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5844009dc0 tx=0x7f584400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d696d78937f0036 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400e070 con 0x7f584c15a8b0 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400bb20 con 0x7f584c15a8b0 2024-05-08T21:00:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f584b7fe700 1 -- 172.21.15.107:0/2379221642 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400be90 con 0x7f584c15a8b0 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 -- 172.21.15.107:0/2379221642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c15a8b0 msgr2=0x7f584c0b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 --2- 172.21.15.107:0/2379221642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c15a8b0 0x7f584c0b2610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5844009dc0 tx=0x7f584400b330 comp rx=0 tx=0).stop 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 -- 172.21.15.107:0/2379221642 shutdown_connections 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 --2- 172.21.15.107:0/2379221642 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c15a8b0 0x7f584c0b2610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 -- 172.21.15.107:0/2379221642 >> 172.21.15.107:0/2379221642 conn(0x7f584c070960 msgr2=0x7f584c070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 -- 172.21.15.107:0/2379221642 shutdown_connections 2024-05-08T21:00:10.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.380+0000 7f58514bf700 1 -- 172.21.15.107:0/2379221642 wait complete. 2024-05-08T21:00:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 Processor -- start 2024-05-08T21:00:10.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 -- start start 2024-05-08T21:00:10.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f584c06ba80 0x7f584c13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c159dc0 0x7f584c150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 0x7f584c14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c1401b0 con 0x7f584c15a8b0 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c150280 con 0x7f584c06ba80 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f58514bf700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c150560 con 0x7f584c159dc0 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f5850cbe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 0x7f584c14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f5850cbe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 0x7f584c14e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37340/0 (socket says 172.21.15.107:37340) 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f5850cbe700 1 -- 172.21.15.107:0/91753757 learned_addr learned my addr 172.21.15.107:0/91753757 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f584bfff700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f584c06ba80 0x7f584c13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.384+0000 7f5843fff700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c159dc0 0x7f584c150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f5850cbe700 1 -- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c159dc0 msgr2=0x7f584c150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f5850cbe700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c159dc0 0x7f584c150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f5850cbe700 1 -- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f584c06ba80 msgr2=0x7f584c13cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f5850cbe700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f584c06ba80 0x7f584c13cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f5850cbe700 1 -- 172.21.15.107:0/91753757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009a70 con 0x7f584c15a8b0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f5850cbe700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 0x7f584c14e0e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5844009fd0 tx=0x7f5844004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844007000 con 0x7f584c15a8b0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5844003a40 con 0x7f584c15a8b0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c150840 con 0x7f584c15a8b0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844003dd0 con 0x7f584c15a8b0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c1512a0 con 0x7f584c15a8b0 2024-05-08T21:00:10.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.388+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c150a80 con 0x7f584c15a8b0 2024-05-08T21:00:10.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.392+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5844012640 con 0x7f584c15a8b0 2024-05-08T21:00:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.392+0000 7f58497fa700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f582c066730 0x7f582c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.392+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f58440878a0 con 0x7f584c15a8b0 2024-05-08T21:00:10.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.392+0000 7f584bfff700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f582c066730 0x7f582c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.392+0000 7f584bfff700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f582c066730 0x7f582c068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f583c0011e0 tx=0x7f583c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.396+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5844058860 con 0x7f584c15a8b0 2024-05-08T21:00:10.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.572+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f584c151490 con 0x7f584c15a8b0 2024-05-08T21:00:10.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58497fa700 1 -- 172.21.15.107:0/91753757 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f584402a020 con 0x7f584c15a8b0 2024-05-08T21:00:10.584 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:10.584 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f582c066730 msgr2=0x7f582c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f582c066730 0x7f582c068bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f583c0011e0 tx=0x7f583c009040 comp rx=0 tx=0).stop 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 msgr2=0x7f584c14e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 0x7f584c14e0e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5844009fd0 tx=0x7f5844004b60 comp rx=0 tx=0).stop 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 shutdown_connections 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f584c15a8b0 0x7f584c14e0e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f582c066730 0x7f582c068bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f584c159dc0 0x7f584c150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 --2- 172.21.15.107:0/91753757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f584c06ba80 0x7f584c13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 >> 172.21.15.107:0/91753757 conn(0x7f584c070960 msgr2=0x7f584c15d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 shutdown_connections 2024-05-08T21:00:10.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.576+0000 7f58514bf700 1 -- 172.21.15.107:0/91753757 wait complete. 2024-05-08T21:00:10.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:10.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:10.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 Processor -- start 2024-05-08T21:00:10.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 -- start start 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f719c0e3b40 0x7f719c0e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f719c006150 0x7f719c0e4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c0e49a0 con 0x7f719c0e0250 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0540b0 con 0x7f719c006150 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aafc7700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0532f0 con 0x7f719c0e3b40 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f719c006150 0x7f719c0e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f719c006150 0x7f719c0e4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37346/0 (socket says 172.21.15.107:37346) 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 -- 172.21.15.107:0/906364970 learned_addr learned my addr 172.21.15.107:0/906364970 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:10.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71a9fc5700 1 --2- 172.21.15.107:0/906364970 >> v2:172.21.15.195:3300/0 conn(0x7f719c0e3b40 0x7f719c0e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 -- 172.21.15.107:0/906364970 >> v2:172.21.15.195:3300/0 conn(0x7f719c0e3b40 msgr2=0x7f719c0e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:10.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 --2- 172.21.15.107:0/906364970 >> v2:172.21.15.195:3300/0 conn(0x7f719c0e3b40 0x7f719c0e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 -- 172.21.15.107:0/906364970 >> v1:172.21.15.107:6789/0 conn(0x7f719c0e0250 legacy=0x7f719c038ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 -- 172.21.15.107:0/906364970 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0535d0 con 0x7f719c006150 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71aa7c6700 1 --2- 172.21.15.107:0/906364970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0e4460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71a404ffd0 tx=0x7f71a4068970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d96fd13713e2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71a8fc3700 1 -- 172.21.15.107:0/906364970 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40679b0 con 0x7f719c006150 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71a8fc3700 1 -- 172.21.15.107:0/906364970 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4067b10 con 0x7f719c006150 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.704+0000 7f71a8fc3700 1 -- 172.21.15.107:0/906364970 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4072130 con 0x7f719c006150 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 -- 172.21.15.107:0/906364970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 msgr2=0x7f719c0e4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 --2- 172.21.15.107:0/906364970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0e4460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71a404ffd0 tx=0x7f71a4068970 comp rx=0 tx=0).stop 2024-05-08T21:00:10.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 -- 172.21.15.107:0/906364970 shutdown_connections 2024-05-08T21:00:10.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 --2- 172.21.15.107:0/906364970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0e4460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 --2- 172.21.15.107:0/906364970 >> v2:172.21.15.195:3300/0 conn(0x7f719c0e3b40 0x7f719c0e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 -- 172.21.15.107:0/906364970 >> 172.21.15.107:0/906364970 conn(0x7f719c054b70 msgr2=0x7f719c054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:10.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 -- 172.21.15.107:0/906364970 shutdown_connections 2024-05-08T21:00:10.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 -- 172.21.15.107:0/906364970 wait complete. 2024-05-08T21:00:10.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 Processor -- start 2024-05-08T21:00:10.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 -- start start 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.708+0000 7f71aafc7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f719c0e3b40 0x7f719c04de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f719c04e390 0x7f719c0e1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c04e820 con 0x7f719c006150 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0067d0 con 0x7f719c0e3b40 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c006ab0 con 0x7f719c04e390 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37348/0 (socket says 172.21.15.107:37348) 2024-05-08T21:00:10.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 -- 172.21.15.107:0/3494145753 learned_addr learned my addr 172.21.15.107:0/3494145753 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a97c4700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f719c0e3b40 0x7f719c04de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aa7c6700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f719c04e390 0x7f719c0e1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 -- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f719c04e390 msgr2=0x7f719c0e1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f719c04e390 0x7f719c0e1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 -- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f719c0e3b40 msgr2=0x7f719c04de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f719c0e3b40 0x7f719c04de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 -- 172.21.15.107:0/3494145753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a404f5c0 con 0x7f719c006150 2024-05-08T21:00:10.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71a9fc5700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0c9d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f71a000e760 tx=0x7f71a000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000c070 con 0x7f719c006150 2024-05-08T21:00:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0013610 con 0x7f719c006150 2024-05-08T21:00:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c006d90 con 0x7f719c006150 2024-05-08T21:00:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0013980 con 0x7f719c006150 2024-05-08T21:00:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c007350 con 0x7f719c006150 2024-05-08T21:00:10.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c005440 con 0x7f719c006150 2024-05-08T21:00:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.712+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71a0013ae0 con 0x7f719c006150 2024-05-08T21:00:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.716+0000 7f719a7fc700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7188066730 0x7f7188068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.716+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f71a0083f80 con 0x7f719c006150 2024-05-08T21:00:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.716+0000 7f71a97c4700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7188066730 0x7f7188068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:10.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.716+0000 7f71a97c4700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7188066730 0x7f7188068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f719c005380 tx=0x7f7194009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:10.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.720+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f71a00b5cf0 con 0x7f719c006150 2024-05-08T21:00:10.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.888+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f719c054280 con 0x7f719c006150 2024-05-08T21:00:10.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.888+0000 7f719a7fc700 1 -- 172.21.15.107:0/3494145753 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71a0051220 con 0x7f719c006150 2024-05-08T21:00:10.898 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:10.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7188066730 msgr2=0x7f7188068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7188066730 0x7f7188068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f719c005380 tx=0x7f7194009040 comp rx=0 tx=0).stop 2024-05-08T21:00:10.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 msgr2=0x7f719c0c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:10.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0c9d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f71a000e760 tx=0x7f71a000ea70 comp rx=0 tx=0).stop 2024-05-08T21:00:10.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 shutdown_connections 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7188066730 0x7f7188068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f719c04e390 0x7f719c0e1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f719c0e3b40 0x7f719c04de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 --2- 172.21.15.107:0/3494145753 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f719c006150 0x7f719c0c9d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 >> 172.21.15.107:0/3494145753 conn(0x7f719c054b70 msgr2=0x7f719c0e40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 shutdown_connections 2024-05-08T21:00:10.902 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:10.892+0000 7f71aafc7700 1 -- 172.21.15.107:0/3494145753 wait complete. 2024-05-08T21:00:10.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:11.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.024+0000 7f437f08e700 1 Processor -- start 2024-05-08T21:00:11.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.024+0000 7f437f08e700 1 -- start start 2024-05-08T21:00:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f437815ead0 0x7f43780cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f437806c7d0 con 0x7f43780ce4f0 2024-05-08T21:00:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43780acb30 con 0x7f437815ae10 2024-05-08T21:00:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43780ce9a0 con 0x7f437815ead0 2024-05-08T21:00:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f437815ead0 0x7f43780cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f437815ead0 0x7f43780cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37356/0 (socket says 172.21.15.107:37356) 2024-05-08T21:00:11.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 -- 172.21.15.107:0/2703908402 learned_addr learned my addr 172.21.15.107:0/2703908402 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d08a700 1 -- 172.21.15.107:0/2703908402 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042683378 0 0) 0x7f43780acb30 con 0x7f437815ae10 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d08a700 1 -- 172.21.15.107:0/2703908402 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43600035d0 con 0x7f437815ae10 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 -- 172.21.15.107:0/2703908402 >> v1:172.21.15.195:6789/0 conn(0x7f437815ae10 legacy=0x7f43780ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 -- 172.21.15.107:0/2703908402 >> v1:172.21.15.107:6789/0 conn(0x7f43780ce4f0 legacy=0x7f437806cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 -- 172.21.15.107:0/2703908402 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f437806c4d0 con 0x7f437815ead0 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d88b700 1 --2- 172.21.15.107:0/2703908402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437815ead0 0x7f43780cdfb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4368009940 tx=0x7f4368009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614d1a8094db16b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d08a700 1 -- 172.21.15.107:0/2703908402 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368011830 con 0x7f437815ead0 2024-05-08T21:00:11.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d08a700 1 -- 172.21.15.107:0/2703908402 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4368011990 con 0x7f437815ead0 2024-05-08T21:00:11.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437d08a700 1 -- 172.21.15.107:0/2703908402 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368011d20 con 0x7f437815ead0 2024-05-08T21:00:11.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- 172.21.15.107:0/2703908402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437815ead0 msgr2=0x7f43780cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 --2- 172.21.15.107:0/2703908402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437815ead0 0x7f43780cdfb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4368009940 tx=0x7f4368009c50 comp rx=0 tx=0).stop 2024-05-08T21:00:11.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- 172.21.15.107:0/2703908402 shutdown_connections 2024-05-08T21:00:11.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 --2- 172.21.15.107:0/2703908402 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f437815ead0 0x7f43780cdfb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- 172.21.15.107:0/2703908402 >> 172.21.15.107:0/2703908402 conn(0x7f43780b0de0 msgr2=0x7f43780b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:11.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- 172.21.15.107:0/2703908402 shutdown_connections 2024-05-08T21:00:11.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.028+0000 7f437f08e700 1 -- 172.21.15.107:0/2703908402 wait complete. 2024-05-08T21:00:11.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 Processor -- start 2024-05-08T21:00:11.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 -- start start 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43780ce4f0 0x7f437815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 0x7f437815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f437815ead0 0x7f43781579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437815e530 con 0x7f43780ce4f0 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43781f5270 con 0x7f437815ead0 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43781f44b0 con 0x7f437815ae10 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 0x7f437815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437e08c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43780ce4f0 0x7f437815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 0x7f437815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41232/0 (socket says 172.21.15.107:41232) 2024-05-08T21:00:11.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 -- 172.21.15.107:0/4273127755 learned_addr learned my addr 172.21.15.107:0/4273127755 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:11.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437e88d700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f437815ead0 0x7f43781579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 -- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f437815ead0 msgr2=0x7f43781579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f437815ead0 0x7f43781579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 -- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43780ce4f0 msgr2=0x7f437815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43780ce4f0 0x7f437815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 -- 172.21.15.107:0/4273127755 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009570 con 0x7f437815ae10 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437e08c700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43780ce4f0 0x7f437815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437d88b700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 0x7f437815dff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4368014040 tx=0x7f4368004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436801a830 con 0x7f437815ae10 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436801e070 con 0x7f437815ae10 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43781f4790 con 0x7f437815ae10 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436801abf0 con 0x7f437815ae10 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.032+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43781f4d50 con 0x7f437815ae10 2024-05-08T21:00:11.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.036+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43780684b0 con 0x7f437815ae10 2024-05-08T21:00:11.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.036+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f436801ad50 con 0x7f437815ae10 2024-05-08T21:00:11.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.036+0000 7f4376ffd700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4364066730 0x7f4364068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.036+0000 7f437e08c700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4364066730 0x7f4364068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.036+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f43680852d0 con 0x7f437815ae10 2024-05-08T21:00:11.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.036+0000 7f437e08c700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4364066730 0x7f4364068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f436c0011e0 tx=0x7f436c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.048+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4368052600 con 0x7f437815ae10 2024-05-08T21:00:11.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:11.093 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:11.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.220+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43780b3ba0 con 0x7f437815ae10 2024-05-08T21:00:11.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.220+0000 7f4376ffd700 1 -- 172.21.15.107:0/4273127755 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4368055c20 con 0x7f437815ae10 2024-05-08T21:00:11.229 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:11.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4364066730 msgr2=0x7f4364068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4364066730 0x7f4364068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f436c0011e0 tx=0x7f436c009040 comp rx=0 tx=0).stop 2024-05-08T21:00:11.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 msgr2=0x7f437815dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 0x7f437815dff0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4368014040 tx=0x7f4368004770 comp rx=0 tx=0).stop 2024-05-08T21:00:11.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 shutdown_connections 2024-05-08T21:00:11.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f437815ead0 0x7f43781579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4364066730 0x7f4364068bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f437815ae10 0x7f437815dff0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 --2- 172.21.15.107:0/4273127755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f43780ce4f0 0x7f437815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 >> 172.21.15.107:0/4273127755 conn(0x7f43780b0de0 msgr2=0x7f4378155700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 shutdown_connections 2024-05-08T21:00:11.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.224+0000 7f437f08e700 1 -- 172.21.15.107:0/4273127755 wait complete. 2024-05-08T21:00:11.244 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:11.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 Processor -- start 2024-05-08T21:00:11.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 -- start start 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c160ce0 0x7fb46c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb46c0d3d40 0x7fb46c0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb46c0cfff0 0x7fb46c0d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0d0480 con 0x7fb46c0cfff0 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c0cf480 con 0x7fb46c0d3d40 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb471bda700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0ce890 con 0x7fb46c160ce0 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb46c0cfff0 0x7fb46c0d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb46c0cfff0 0x7fb46c0d1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37370/0 (socket says 172.21.15.107:37370) 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 -- 172.21.15.107:0/1078825363 learned_addr learned my addr 172.21.15.107:0/1078825363 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46b7fe700 1 --2- 172.21.15.107:0/1078825363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c160ce0 0x7fb46c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46affd700 1 --2- 172.21.15.107:0/1078825363 >> v2:172.21.15.195:3300/0 conn(0x7fb46c0d3d40 0x7fb46c0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 -- 172.21.15.107:0/1078825363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c160ce0 msgr2=0x7fb46c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 --2- 172.21.15.107:0/1078825363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c160ce0 0x7fb46c0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 -- 172.21.15.107:0/1078825363 >> v2:172.21.15.195:3300/0 conn(0x7fb46c0d3d40 msgr2=0x7fb46c0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 --2- 172.21.15.107:0/1078825363 >> v2:172.21.15.195:3300/0 conn(0x7fb46c0d3d40 0x7fb46c0cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 -- 172.21.15.107:0/1078825363 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0ceb50 con 0x7fb46c0cfff0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46bfff700 1 --2- 172.21.15.107:0/1078825363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0cfff0 0x7fb46c0d1090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb46c08bbf0 tx=0x7fb46400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d675ee435706d67c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46a7fc700 1 -- 172.21.15.107:0/1078825363 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400e070 con 0x7fb46c0cfff0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46a7fc700 1 -- 172.21.15.107:0/1078825363 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400b980 con 0x7fb46c0cfff0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.356+0000 7fb46a7fc700 1 -- 172.21.15.107:0/1078825363 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400bd30 con 0x7fb46c0cfff0 2024-05-08T21:00:11.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- 172.21.15.107:0/1078825363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0cfff0 msgr2=0x7fb46c0d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- 172.21.15.107:0/1078825363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0cfff0 0x7fb46c0d1090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb46c08bbf0 tx=0x7fb46400b330 comp rx=0 tx=0).stop 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- 172.21.15.107:0/1078825363 shutdown_connections 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- 172.21.15.107:0/1078825363 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0cfff0 0x7fb46c0d1090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- 172.21.15.107:0/1078825363 >> v2:172.21.15.195:3300/0 conn(0x7fb46c0d3d40 0x7fb46c0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- 172.21.15.107:0/1078825363 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c160ce0 0x7fb46c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- 172.21.15.107:0/1078825363 >> 172.21.15.107:0/1078825363 conn(0x7fb46c09c4c0 msgr2=0x7fb46c0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- 172.21.15.107:0/1078825363 shutdown_connections 2024-05-08T21:00:11.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- 172.21.15.107:0/1078825363 wait complete. 2024-05-08T21:00:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 Processor -- start 2024-05-08T21:00:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- start start 2024-05-08T21:00:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c0cfff0 0x7fb46c1f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 0x7fb46c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb46c160ce0 0x7fb46c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0cb850 con 0x7fb46c0d3d40 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0cac40 con 0x7fb46c160ce0 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb471bda700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0caf20 con 0x7fb46c0cfff0 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.360+0000 7fb46affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 0x7fb46c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 0x7fb46c0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37374/0 (socket says 172.21.15.107:37374) 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 -- 172.21.15.107:0/3200991959 learned_addr learned my addr 172.21.15.107:0/3200991959 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46b7fe700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c0cfff0 0x7fb46c1f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46bfff700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb46c160ce0 0x7fb46c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 -- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c0cfff0 msgr2=0x7fb46c1f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c0cfff0 0x7fb46c1f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 -- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb46c160ce0 msgr2=0x7fb46c0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb46c160ce0 0x7fb46c0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 -- 172.21.15.107:0/3200991959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009b30 con 0x7fb46c0d3d40 2024-05-08T21:00:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb46affd700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 0x7fb46c0ca260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00e810 tx=0x7fb45c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00c070 con 0x7fb46c0d3d40 2024-05-08T21:00:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c013610 con 0x7fb46c0d3d40 2024-05-08T21:00:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c0cb200 con 0x7fb46c0d3d40 2024-05-08T21:00:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0139a0 con 0x7fb46c0d3d40 2024-05-08T21:00:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c1f48a0 con 0x7fb46c0d3d40 2024-05-08T21:00:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.364+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c0cba00 con 0x7fb46c0d3d40 2024-05-08T21:00:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.368+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb45c013b00 con 0x7fb46c0d3d40 2024-05-08T21:00:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.368+0000 7fb453fff700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb458066730 0x7fb458068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.368+0000 7fb46b7fe700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb458066730 0x7fb458068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.368+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fb45c083f80 con 0x7fb46c0d3d40 2024-05-08T21:00:11.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.368+0000 7fb46b7fe700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb458066730 0x7fb458068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb460006b40 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.372+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb45c0b5cf0 con 0x7fb46c0d3d40 2024-05-08T21:00:11.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.544+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb46c0d15a0 con 0x7fb46c0d3d40 2024-05-08T21:00:11.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.544+0000 7fb453fff700 1 -- 172.21.15.107:0/3200991959 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb46c0cba00 con 0x7fb46c0d3d40 2024-05-08T21:00:11.553 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:11.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb458066730 msgr2=0x7fb458068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb458066730 0x7fb458068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb460006b40 tx=0x7fb460008040 comp rx=0 tx=0).stop 2024-05-08T21:00:11.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 msgr2=0x7fb46c0ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 0x7fb46c0ca260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00e810 tx=0x7fb45c00eb20 comp rx=0 tx=0).stop 2024-05-08T21:00:11.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 shutdown_connections 2024-05-08T21:00:11.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb46c160ce0 0x7fb46c0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb46c0d3d40 0x7fb46c0ca260 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb458066730 0x7fb458068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 --2- 172.21.15.107:0/3200991959 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb46c0cfff0 0x7fb46c1f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 >> 172.21.15.107:0/3200991959 conn(0x7fb46c09c4c0 msgr2=0x7fb46c15df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:11.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 shutdown_connections 2024-05-08T21:00:11.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.548+0000 7fb471bda700 1 -- 172.21.15.107:0/3200991959 wait complete. 2024-05-08T21:00:11.569 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:11.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e359e700 1 Processor -- start 2024-05-08T21:00:11.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e359e700 1 -- start start 2024-05-08T21:00:11.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e41624b0 0x7fb4e4070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e359e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e4158960 con 0x7fb4e4071e70 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e359e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40ae990 con 0x7fb4e40b3c20 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40b1f60 con 0x7fb4e41624b0 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e1d9b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fb4e4071e70 0x7fb4e4070110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39524/0 (socket says 172.21.15.107:39524) 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e1d9b700 1 -- 172.21.15.107:0/2381634969 learned_addr learned my addr 172.21.15.107:0/2381634969 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e2d9d700 1 --2- 172.21.15.107:0/2381634969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e41624b0 0x7fb4e4070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308727908 0 0) 0x7fb4e4158960 con 0x7fb4e4071e70 2024-05-08T21:00:11.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d00035d0 con 0x7fb4e4071e70 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021295268 0 0) 0x7fb4e40ae990 con 0x7fb4e40b3c20 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e4158960 con 0x7fb4e40b3c20 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616517990 0 0) 0x7fb4d00035d0 con 0x7fb4e4071e70 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e2d9d700 1 -- 172.21.15.107:0/2381634969 >> v1:172.21.15.195:6789/0 conn(0x7fb4e40b3c20 legacy=0x7fb4e40b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e2d9d700 1 -- 172.21.15.107:0/2381634969 >> v1:172.21.15.107:6789/0 conn(0x7fb4e4071e70 legacy=0x7fb4e4070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.672+0000 7fb4e2d9d700 1 -- 172.21.15.107:0/2381634969 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40b2170 con 0x7fb4e41624b0 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e2d9d700 1 --2- 172.21.15.107:0/2381634969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e41624b0 0x7fb4e4070820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009880 tx=0x7fb4dc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cdd03111075473b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40019f0 con 0x7fb4e41624b0 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc004030 con 0x7fb4e41624b0 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e159a700 1 -- 172.21.15.107:0/2381634969 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0043a0 con 0x7fb4e41624b0 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 -- 172.21.15.107:0/2381634969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e41624b0 msgr2=0x7fb4e4070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 --2- 172.21.15.107:0/2381634969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e41624b0 0x7fb4e4070820 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009880 tx=0x7fb4dc009b90 comp rx=0 tx=0).stop 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 -- 172.21.15.107:0/2381634969 shutdown_connections 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 --2- 172.21.15.107:0/2381634969 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e41624b0 0x7fb4e4070820 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 -- 172.21.15.107:0/2381634969 >> 172.21.15.107:0/2381634969 conn(0x7fb4e406c330 msgr2=0x7fb4e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 -- 172.21.15.107:0/2381634969 shutdown_connections 2024-05-08T21:00:11.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 -- 172.21.15.107:0/2381634969 wait complete. 2024-05-08T21:00:11.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 Processor -- start 2024-05-08T21:00:11.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.676+0000 7fb4e359e700 1 -- start start 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e4071e70 0x7fb4e4152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 0x7fb4e4143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e41624b0 0x7fb4e414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e414e510 con 0x7fb4e40b3c20 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e414dc00 con 0x7fb4e41624b0 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4164370 con 0x7fb4e4071e70 2024-05-08T21:00:11.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 0x7fb4e4143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 0x7fb4e4143060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37386/0 (socket says 172.21.15.107:37386) 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 -- 172.21.15.107:0/3845164892 learned_addr learned my addr 172.21.15.107:0/3845164892 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e259c700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e4071e70 0x7fb4e4152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e2d9d700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e41624b0 0x7fb4e414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 -- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e4071e70 msgr2=0x7fb4e4152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e4071e70 0x7fb4e4152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 -- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e41624b0 msgr2=0x7fb4e414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e41624b0 0x7fb4e414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 -- 172.21.15.107:0/3845164892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc0094b0 con 0x7fb4e40b3c20 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e2d9d700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e41624b0 0x7fb4e414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e1d9b700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 0x7fb4e4143060 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4002230 tx=0x7fb4d400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d400ab70 con 0x7fb4e40b3c20 2024-05-08T21:00:11.690 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d400acf0 con 0x7fb4e40b3c20 2024-05-08T21:00:11.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e414dec0 con 0x7fb4e40b3c20 2024-05-08T21:00:11.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4007310 con 0x7fb4e40b3c20 2024-05-08T21:00:11.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e41504c0 con 0x7fb4e40b3c20 2024-05-08T21:00:11.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.680+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e406eb50 con 0x7fb4e40b3c20 2024-05-08T21:00:11.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.684+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4d4007470 con 0x7fb4e40b3c20 2024-05-08T21:00:11.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.684+0000 7fb4daffd700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb4c4066780 0x7fb4c4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:11.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.684+0000 7fb4e259c700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb4c4066780 0x7fb4c4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:11.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.684+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fb4d4084150 con 0x7fb4e40b3c20 2024-05-08T21:00:11.692 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.684+0000 7fb4e259c700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb4c4066780 0x7fb4c4068c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0017b0 tx=0x7fb4cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:11.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.688+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb4d4051460 con 0x7fb4e40b3c20 2024-05-08T21:00:11.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.872+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4e40684b0 con 0x7fb4e40b3c20 2024-05-08T21:00:11.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.872+0000 7fb4daffd700 1 -- 172.21.15.107:0/3845164892 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4d400ae60 con 0x7fb4e40b3c20 2024-05-08T21:00:11.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb4c4066780 msgr2=0x7fb4c4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb4c4066780 0x7fb4c4068c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0017b0 tx=0x7fb4cc009040 comp rx=0 tx=0).stop 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 msgr2=0x7fb4e4143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 0x7fb4e4143060 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4002230 tx=0x7fb4d400cf50 comp rx=0 tx=0).stop 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 shutdown_connections 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e41624b0 0x7fb4e414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4e40b3c20 0x7fb4e4143060 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb4c4066780 0x7fb4c4068c40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 --2- 172.21.15.107:0/3845164892 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb4e4071e70 0x7fb4e4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 >> 172.21.15.107:0/3845164892 conn(0x7fb4e406c330 msgr2=0x7fb4e40cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 shutdown_connections 2024-05-08T21:00:11.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:11.876+0000 7fb4e359e700 1 -- 172.21.15.107:0/3845164892 wait complete. 2024-05-08T21:00:11.887 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:11.899 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi107.front.sepia.ceph.com... 2024-05-08T21:00:11.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:11.899 DEBUG:teuthology.orchestra.run.smithi107:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-08T21:00:11.913 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi107.stderr:ceph-fuse[33810]: fuse finished with error 0 and tester_r 0 2024-05-08T21:00:11.914 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:00:11.937 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:00:11.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:11.938 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-08T21:00:11.945 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T21:00:11.945 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:11.953 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T21:00:11.953 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:11.960 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:12.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 Processor -- start 2024-05-08T21:00:12.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 -- start start 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f297015afa0 0x7f297015b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f297015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297015eda0 con 0x7f297015f770 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297015ea70 con 0x7f297015afa0 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296f59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297015bd40 con 0x7f297015b8c0 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296e59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f297015afa0 0x7f297015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296e59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f297015afa0 0x7f297015b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37392/0 (socket says 172.21.15.107:37392) 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296e59c700 1 -- 172.21.15.107:0/4184979600 learned_addr learned my addr 172.21.15.107:0/4184979600 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.096+0000 7f296dd9b700 1 --2- 172.21.15.107:0/4184979600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f297015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296e59c700 1 -- 172.21.15.107:0/4184979600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 msgr2=0x7f297015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296e59c700 1 --2- 172.21.15.107:0/4184979600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f297015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296e59c700 1 -- 172.21.15.107:0/4184979600 >> v1:172.21.15.195:6789/0 conn(0x7f297015f770 legacy=0x7f29700b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296e59c700 1 -- 172.21.15.107:0/4184979600 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297015c020 con 0x7f297015afa0 2024-05-08T21:00:12.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296e59c700 1 --2- 172.21.15.107:0/4184979600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f297015b380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2960009910 tx=0x7f2960009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b69c5036c7d2c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296d59a700 1 -- 172.21.15.107:0/4184979600 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011830 con 0x7f297015afa0 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296d59a700 1 -- 172.21.15.107:0/4184979600 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960011990 con 0x7f297015afa0 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296d59a700 1 -- 172.21.15.107:0/4184979600 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960011d40 con 0x7f297015afa0 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 -- 172.21.15.107:0/4184979600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 msgr2=0x7f297015b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 --2- 172.21.15.107:0/4184979600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f297015b380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2960009910 tx=0x7f2960009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 -- 172.21.15.107:0/4184979600 shutdown_connections 2024-05-08T21:00:12.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 --2- 172.21.15.107:0/4184979600 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f297015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 --2- 172.21.15.107:0/4184979600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f297015b380 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 -- 172.21.15.107:0/4184979600 >> 172.21.15.107:0/4184979600 conn(0x7f297006c330 msgr2=0x7f297006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:12.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 -- 172.21.15.107:0/4184979600 shutdown_connections 2024-05-08T21:00:12.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.100+0000 7f296f59e700 1 -- 172.21.15.107:0/4184979600 wait complete. 2024-05-08T21:00:12.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 Processor -- start 2024-05-08T21:00:12.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 -- start start 2024-05-08T21:00:12.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f29700a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f29701e8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f297015f770 0x7f29701407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701e86b0 con 0x7f297015afa0 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970141280 con 0x7f297015f770 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970141560 con 0x7f297015b8c0 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f29700a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f29700a8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37398/0 (socket says 172.21.15.107:37398) 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 -- 172.21.15.107:0/835187140 learned_addr learned my addr 172.21.15.107:0/835187140 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296dd9b700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f29701e8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296ed9d700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f297015f770 0x7f29701407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 -- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 msgr2=0x7f29701e8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f29701e8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 -- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f297015f770 msgr2=0x7f29701407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f297015f770 0x7f29701407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 -- 172.21.15.107:0/835187140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009570 con 0x7f297015afa0 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296ed9d700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f297015f770 0x7f29701407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296e59c700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f29700a8560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2960000c00 tx=0x7f2960004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960004610 con 0x7f297015afa0 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29600036c0 con 0x7f297015afa0 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2970141840 con 0x7f297015afa0 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960003a50 con 0x7f297015afa0 2024-05-08T21:00:12.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.104+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970141e00 con 0x7f297015afa0 2024-05-08T21:00:12.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.108+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29700684b0 con 0x7f297015afa0 2024-05-08T21:00:12.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.108+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2960003bb0 con 0x7f297015afa0 2024-05-08T21:00:12.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.108+0000 7f2966ffd700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2954066730 0x7f2954068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.108+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f2960021030 con 0x7f297015afa0 2024-05-08T21:00:12.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.108+0000 7f296dd9b700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2954066730 0x7f2954068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.108+0000 7f296dd9b700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2954066730 0x7f2954068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29580074a0 tx=0x7f295800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.112+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2960053100 con 0x7f297015afa0 2024-05-08T21:00:12.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.284+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29700ae710 con 0x7f297015afa0 2024-05-08T21:00:12.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f2966ffd700 1 -- 172.21.15.107:0/835187140 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f2960003e60 con 0x7f297015afa0 2024-05-08T21:00:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:12.296 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2954066730 msgr2=0x7f2954068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2954066730 0x7f2954068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f29580074a0 tx=0x7f295800b040 comp rx=0 tx=0).stop 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 msgr2=0x7f29700a8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f29700a8560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2960000c00 tx=0x7f2960004770 comp rx=0 tx=0).stop 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 shutdown_connections 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f297015f770 0x7f29701407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2954066730 0x7f2954068bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f297015b8c0 0x7f29701e8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 --2- 172.21.15.107:0/835187140 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f297015afa0 0x7f29700a8560 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 >> 172.21.15.107:0/835187140 conn(0x7f297006c330 msgr2=0x7f29700af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:12.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 shutdown_connections 2024-05-08T21:00:12.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.288+0000 7f296f59e700 1 -- 172.21.15.107:0/835187140 wait complete. 2024-05-08T21:00:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:12.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:12.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 Processor -- start 2024-05-08T21:00:12.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 -- start start 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7f80d3510 0x7fd7f80afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80b0fa0 con 0x7fd7f815d180 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80b4990 con 0x7fd7f80d3510 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7fcc16700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b0390 con 0x7fd7f815d560 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7f80d3510 0x7fd7f80afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd7f80d3510 0x7fd7f80afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37406/0 (socket says 172.21.15.107:37406) 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/65092424 learned_addr learned my addr 172.21.15.107:0/65092424 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f7fff700 1 --2- 172.21.15.107:0/65092424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/65092424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 msgr2=0x7fd7f80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 --2- 172.21.15.107:0/65092424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f80b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/65092424 >> v1:172.21.15.195:6789/0 conn(0x7fd7f815d180 legacy=0x7fd7f80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/65092424 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80b0670 con 0x7fd7f80d3510 2024-05-08T21:00:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.424+0000 7fd7f6ffd700 1 --2- 172.21.15.107:0/65092424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f80d3510 0x7fd7f80afd20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009910 tx=0x7fd7e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64e717f36c48a15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f67fc700 1 -- 172.21.15.107:0/65092424 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8011830 con 0x7fd7f80d3510 2024-05-08T21:00:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f67fc700 1 -- 172.21.15.107:0/65092424 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8011990 con 0x7fd7f80d3510 2024-05-08T21:00:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f67fc700 1 -- 172.21.15.107:0/65092424 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8011d40 con 0x7fd7f80d3510 2024-05-08T21:00:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- 172.21.15.107:0/65092424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f80d3510 msgr2=0x7fd7f80afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/65092424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f80d3510 0x7fd7f80afd20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009910 tx=0x7fd7e8009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- 172.21.15.107:0/65092424 shutdown_connections 2024-05-08T21:00:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/65092424 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f80b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/65092424 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f80d3510 0x7fd7f80afd20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- 172.21.15.107:0/65092424 >> 172.21.15.107:0/65092424 conn(0x7fd7f808b000 msgr2=0x7fd7f809c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:12.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- 172.21.15.107:0/65092424 shutdown_connections 2024-05-08T21:00:12.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- 172.21.15.107:0/65092424 wait complete. 2024-05-08T21:00:12.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 Processor -- start 2024-05-08T21:00:12.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- start start 2024-05-08T21:00:12.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7f80d3510 0x7fd7f814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 0x7fd7f80b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80cc350 con 0x7fd7f815d180 2024-05-08T21:00:12.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b6f90 con 0x7fd7f80d3510 2024-05-08T21:00:12.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7fcc16700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b7230 con 0x7fd7f815d560 2024-05-08T21:00:12.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 0x7fd7f80b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 0x7fd7f80b7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37408/0 (socket says 172.21.15.107:37408) 2024-05-08T21:00:12.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/399660720 learned_addr learned my addr 172.21.15.107:0/399660720 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:12.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f7fff700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.428+0000 7fd7f77fe700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7f80d3510 0x7fd7f814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 msgr2=0x7fd7f815ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7f6ffd700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f815ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7f80d3510 msgr2=0x7fd7f814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7f6ffd700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7f80d3510 0x7fd7f814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7f6ffd700 1 -- 172.21.15.107:0/399660720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8009570 con 0x7fd7f815d180 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7f6ffd700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 0x7fd7f80b7cd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8000c00 tx=0x7fd7e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8004510 con 0x7fd7f815d180 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80036c0 con 0x7fd7f815d180 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f80cc070 con 0x7fd7f815d180 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8003a70 con 0x7fd7f815d180 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f80b77b0 con 0x7fd7f815d180 2024-05-08T21:00:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.432+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f80677c0 con 0x7fd7f815d180 2024-05-08T21:00:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.436+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd7e8003bd0 con 0x7fd7f815d180 2024-05-08T21:00:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.436+0000 7fd7dffff700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd7e4066730 0x7fd7e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.436+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fd7e8021030 con 0x7fd7f815d180 2024-05-08T21:00:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.436+0000 7fd7f77fe700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd7e4066730 0x7fd7e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.436+0000 7fd7f77fe700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd7e4066730 0x7fd7e4068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec000f60 tx=0x7fd7ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.444+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd7e8052a80 con 0x7fd7f815d180 2024-05-08T21:00:12.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.612+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7f80684b0 con 0x7fd7f815d180 2024-05-08T21:00:12.621 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.612+0000 7fd7dffff700 1 -- 172.21.15.107:0/399660720 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7e80560a0 con 0x7fd7f815d180 2024-05-08T21:00:12.621 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:12.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd7e4066730 msgr2=0x7fd7e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd7e4066730 0x7fd7e4068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec000f60 tx=0x7fd7ec009040 comp rx=0 tx=0).stop 2024-05-08T21:00:12.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 msgr2=0x7fd7f80b7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 0x7fd7f80b7cd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8000c00 tx=0x7fd7e8004770 comp rx=0 tx=0).stop 2024-05-08T21:00:12.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 shutdown_connections 2024-05-08T21:00:12.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd7e4066730 0x7fd7e4068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd7f815d560 0x7fd7f815ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7f815d180 0x7fd7f80b7cd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 --2- 172.21.15.107:0/399660720 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7f80d3510 0x7fd7f814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 >> 172.21.15.107:0/399660720 conn(0x7fd7f808b000 msgr2=0x7fd7f80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:12.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 shutdown_connections 2024-05-08T21:00:12.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.616+0000 7fd7fcc16700 1 -- 172.21.15.107:0/399660720 wait complete. 2024-05-08T21:00:12.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:12.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b03fff700 1 Processor -- start 2024-05-08T21:00:12.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b03fff700 1 -- start start 2024-05-08T21:00:12.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b0415e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b03fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0415a350 con 0x7f8b040abda0 2024-05-08T21:00:12.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b03fff700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0415a5b0 con 0x7f8b04157b30 2024-05-08T21:00:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b03fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0415e980 con 0x7f8b040adf30 2024-05-08T21:00:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.748+0000 7f8b027fc700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8b040abda0 0x7f8b040b2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39540/0 (socket says 172.21.15.107:39540) 2024-05-08T21:00:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b027fc700 1 -- 172.21.15.107:0/3334334545 learned_addr learned my addr 172.21.15.107:0/3334334545 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b037fe700 1 --2- 172.21.15.107:0/3334334545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b0415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b01ffb700 1 -- 172.21.15.107:0/3334334545 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932995631 0 0) 0x7f8b0415a350 con 0x7f8b040abda0 2024-05-08T21:00:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b01ffb700 1 -- 172.21.15.107:0/3334334545 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aec0035d0 con 0x7f8b040abda0 2024-05-08T21:00:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b037fe700 1 -- 172.21.15.107:0/3334334545 >> v1:172.21.15.195:6789/0 conn(0x7f8b04157b30 legacy=0x7f8b040ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b037fe700 1 -- 172.21.15.107:0/3334334545 >> v1:172.21.15.107:6789/0 conn(0x7f8b040abda0 legacy=0x7f8b040b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b037fe700 1 -- 172.21.15.107:0/3334334545 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0415a890 con 0x7f8b040adf30 2024-05-08T21:00:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b037fe700 1 --2- 172.21.15.107:0/3334334545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b0415e350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009dc0 tx=0x7f8afc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=308da11e0263a1c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b01ffb700 1 -- 172.21.15.107:0/3334334545 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00e070 con 0x7f8b040adf30 2024-05-08T21:00:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b01ffb700 1 -- 172.21.15.107:0/3334334545 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00bb20 con 0x7f8b040adf30 2024-05-08T21:00:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b01ffb700 1 -- 172.21.15.107:0/3334334545 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc012430 con 0x7f8b040adf30 2024-05-08T21:00:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 -- 172.21.15.107:0/3334334545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 msgr2=0x7f8b0415e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3334334545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b0415e350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8afc009dc0 tx=0x7f8afc00b330 comp rx=0 tx=0).stop 2024-05-08T21:00:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 -- 172.21.15.107:0/3334334545 shutdown_connections 2024-05-08T21:00:12.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3334334545 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b0415e350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 -- 172.21.15.107:0/3334334545 >> 172.21.15.107:0/3334334545 conn(0x7f8b040b0de0 msgr2=0x7f8b040b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 -- 172.21.15.107:0/3334334545 shutdown_connections 2024-05-08T21:00:12.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.752+0000 7f8b03fff700 1 -- 172.21.15.107:0/3334334545 wait complete. 2024-05-08T21:00:12.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 Processor -- start 2024-05-08T21:00:12.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 -- start start 2024-05-08T21:00:12.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 0x7f8b041eea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b04148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b04157b30 0x7f8b0414cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0414b460 con 0x7f8b040abda0 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b041eefa0 con 0x7f8b04157b30 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04149780 con 0x7f8b040adf30 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 0x7f8b041eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 0x7f8b041eea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37420/0 (socket says 172.21.15.107:37420) 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 -- 172.21.15.107:0/3489019469 learned_addr learned my addr 172.21.15.107:0/3489019469 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b037fe700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b04157b30 0x7f8b0414cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b027fc700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b04148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 -- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 msgr2=0x7f8b04148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b04148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 -- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b04157b30 msgr2=0x7f8b0414cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b04157b30 0x7f8b0414cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 -- 172.21.15.107:0/3489019469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009a70 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b037fe700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b04157b30 0x7f8b0414cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b027fc700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b04148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b02ffd700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 0x7f8b041eea60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c530 tx=0x7f8af800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80052d0 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af8005430 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b04149a60 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af80055a0 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.756+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04149450 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.760+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0414b5d0 con 0x7f8b040abda0 2024-05-08T21:00:12.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.760+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8af80038e0 con 0x7f8b040abda0 2024-05-08T21:00:12.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.760+0000 7f8aeb7fe700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8af0066730 0x7f8af0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:12.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.760+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f8af8083730 con 0x7f8b040abda0 2024-05-08T21:00:12.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.760+0000 7f8b027fc700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8af0066730 0x7f8af0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:12.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.760+0000 7f8b027fc700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8af0066730 0x7f8af0068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b0415a0f0 tx=0x7f8af4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:12.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.768+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8af8050950 con 0x7f8b040abda0 2024-05-08T21:00:12.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.932+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b040684b0 con 0x7f8b040abda0 2024-05-08T21:00:12.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.932+0000 7f8aeb7fe700 1 -- 172.21.15.107:0/3489019469 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8af8053f70 con 0x7f8b040abda0 2024-05-08T21:00:12.940 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:12.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.932+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8af0066730 msgr2=0x7f8af0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8af0066730 0x7f8af0068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8b0415a0f0 tx=0x7f8af4009040 comp rx=0 tx=0).stop 2024-05-08T21:00:12.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 msgr2=0x7f8b041eea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:12.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 0x7f8b041eea60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c530 tx=0x7f8af800c8f0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 shutdown_connections 2024-05-08T21:00:12.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8b04157b30 0x7f8b0414cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8af0066730 0x7f8af0068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8b040adf30 0x7f8b04148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 --2- 172.21.15.107:0/3489019469 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b040abda0 0x7f8b041eea60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:12.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 >> 172.21.15.107:0/3489019469 conn(0x7f8b040b0de0 msgr2=0x7f8b040b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:12.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 shutdown_connections 2024-05-08T21:00:12.944 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:12.936+0000 7f8b03fff700 1 -- 172.21.15.107:0/3489019469 wait complete. 2024-05-08T21:00:12.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:13.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 Processor -- start 2024-05-08T21:00:13.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 -- start start 2024-05-08T21:00:13.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbc7c160920 0x7fbc7c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c0d1da0 0x7fbc7c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0d3d40 con 0x7fbc7c0cec30 2024-05-08T21:00:13.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0d0d00 con 0x7fbc7c160920 2024-05-08T21:00:13.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.068+0000 7fbc81e54700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0d0fe0 con 0x7fbc7c0d1da0 2024-05-08T21:00:13.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc80e52700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbc7c160920 0x7fbc7c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7bfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c0d1da0 0x7fbc7c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81653700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fbc7c0cec30 0x7fbc7c161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:56028/0 (socket says 172.21.15.107:56028) 2024-05-08T21:00:13.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81653700 1 -- 172.21.15.107:0/2448898401 learned_addr learned my addr 172.21.15.107:0/2448898401 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:13.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7b7fe700 1 -- 172.21.15.107:0/2448898401 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098635643 0 0) 0x7fbc7c0d3d40 con 0x7fbc7c0cec30 2024-05-08T21:00:13.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7b7fe700 1 -- 172.21.15.107:0/2448898401 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc640035d0 con 0x7fbc7c0cec30 2024-05-08T21:00:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7bfff700 1 -- 172.21.15.107:0/2448898401 >> v2:172.21.15.195:3300/0 conn(0x7fbc7c160920 msgr2=0x7fbc7c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7bfff700 1 --2- 172.21.15.107:0/2448898401 >> v2:172.21.15.195:3300/0 conn(0x7fbc7c160920 0x7fbc7c0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7bfff700 1 -- 172.21.15.107:0/2448898401 >> v1:172.21.15.195:6789/0 conn(0x7fbc7c0cec30 legacy=0x7fbc7c161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7bfff700 1 -- 172.21.15.107:0/2448898401 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0d12c0 con 0x7fbc7c0d1da0 2024-05-08T21:00:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7bfff700 1 --2- 172.21.15.107:0/2448898401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c0d1da0 0x7fbc7c0cf940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009850 tx=0x7fbc6c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d86341995767895 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7b7fe700 1 -- 172.21.15.107:0/2448898401 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c011830 con 0x7fbc7c0d1da0 2024-05-08T21:00:13.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7b7fe700 1 -- 172.21.15.107:0/2448898401 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c011990 con 0x7fbc7c0d1da0 2024-05-08T21:00:13.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc7b7fe700 1 -- 172.21.15.107:0/2448898401 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c011d40 con 0x7fbc7c0d1da0 2024-05-08T21:00:13.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 -- 172.21.15.107:0/2448898401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c0d1da0 msgr2=0x7fbc7c0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 --2- 172.21.15.107:0/2448898401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c0d1da0 0x7fbc7c0cf940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009850 tx=0x7fbc6c009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:13.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 -- 172.21.15.107:0/2448898401 shutdown_connections 2024-05-08T21:00:13.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 --2- 172.21.15.107:0/2448898401 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c0d1da0 0x7fbc7c0cf940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 --2- 172.21.15.107:0/2448898401 >> v2:172.21.15.195:3300/0 conn(0x7fbc7c160920 0x7fbc7c0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 -- 172.21.15.107:0/2448898401 >> 172.21.15.107:0/2448898401 conn(0x7fbc7c09c340 msgr2=0x7fbc7c0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:13.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 -- 172.21.15.107:0/2448898401 shutdown_connections 2024-05-08T21:00:13.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.072+0000 7fbc81e54700 1 -- 172.21.15.107:0/2448898401 wait complete. 2024-05-08T21:00:13.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 Processor -- start 2024-05-08T21:00:13.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 -- start start 2024-05-08T21:00:13.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 0x7fbc7c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc7c0d1da0 0x7fbc7c0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c160920 0x7fbc7c0b8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cb130 con 0x7fbc7c0cec30 2024-05-08T21:00:13.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0ca4b0 con 0x7fbc7c0d1da0 2024-05-08T21:00:13.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0ca790 con 0x7fbc7c160920 2024-05-08T21:00:13.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 0x7fbc7c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 0x7fbc7c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37422/0 (socket says 172.21.15.107:37422) 2024-05-08T21:00:13.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 -- 172.21.15.107:0/3767660125 learned_addr learned my addr 172.21.15.107:0/3767660125 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:13.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc7bfff700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc7c0d1da0 0x7fbc7c0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81653700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c160920 0x7fbc7c0b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 -- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c160920 msgr2=0x7fbc7c0b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c160920 0x7fbc7c0b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 -- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc7c0d1da0 msgr2=0x7fbc7c0b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc7c0d1da0 0x7fbc7c0b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 -- 172.21.15.107:0/3767660125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0094b0 con 0x7fbc7c0cec30 2024-05-08T21:00:13.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc7bfff700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc7c0d1da0 0x7fbc7c0b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:13.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc80e52700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 0x7fbc7c153aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000e840 tx=0x7fbc7000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc700095a0 con 0x7fbc7c0cec30 2024-05-08T21:00:13.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70013680 con 0x7fbc7c0cec30 2024-05-08T21:00:13.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c160e80 con 0x7fbc7c0cec30 2024-05-08T21:00:13.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc700139f0 con 0x7fbc7c0cec30 2024-05-08T21:00:13.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.076+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c0cad50 con 0x7fbc7c0cec30 2024-05-08T21:00:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.080+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c0684b0 con 0x7fbc7c0cec30 2024-05-08T21:00:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.080+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc70013b50 con 0x7fbc7c0cec30 2024-05-08T21:00:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.080+0000 7fbc797fa700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbc68066730 0x7fbc68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.080+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fbc70084030 con 0x7fbc7c0cec30 2024-05-08T21:00:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.080+0000 7fbc7bfff700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbc68066730 0x7fbc68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.084+0000 7fbc7bfff700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbc68066730 0x7fbc68068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0090b0 tx=0x7fbc6c01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.084+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fbc70051360 con 0x7fbc7c0cec30 2024-05-08T21:00:13.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc7c0cf510 con 0x7fbc7c0cec30 2024-05-08T21:00:13.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc797fa700 1 -- 172.21.15.107:0/3767660125 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc70054980 con 0x7fbc7c0cec30 2024-05-08T21:00:13.264 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:13.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbc68066730 msgr2=0x7fbc68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbc68066730 0x7fbc68068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0090b0 tx=0x7fbc6c01c040 comp rx=0 tx=0).stop 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 msgr2=0x7fbc7c153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 0x7fbc7c153aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000e840 tx=0x7fbc7000eb50 comp rx=0 tx=0).stop 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 shutdown_connections 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fbc68066730 0x7fbc68068bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbc7c160920 0x7fbc7c0b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbc7c0d1da0 0x7fbc7c0b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 --2- 172.21.15.107:0/3767660125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbc7c0cec30 0x7fbc7c153aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 >> 172.21.15.107:0/3767660125 conn(0x7fbc7c09c340 msgr2=0x7fbc7c15f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:13.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 shutdown_connections 2024-05-08T21:00:13.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.256+0000 7fbc81e54700 1 -- 172.21.15.107:0/3767660125 wait complete. 2024-05-08T21:00:13.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:13.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 Processor -- start 2024-05-08T21:00:13.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 -- start start 2024-05-08T21:00:13.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0f40d0000 0x7fa0f40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fa0f40ce070 0x7fa0f40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f40ca540 con 0x7fa0f415d300 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f415d6e0 con 0x7fa0f40d0000 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.384+0000 7fa0fabdb700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f40ce960 con 0x7fa0f40ce070 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0f40d0000 0x7fa0f40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa0f40d0000 0x7fa0f40cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37434/0 (socket says 172.21.15.107:37434) 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f9bd9700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa0f415d300 0x7fa0f40cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39548/0 (socket says 172.21.15.107:39548) 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 -- 172.21.15.107:0/1274577245 learned_addr learned my addr 172.21.15.107:0/1274577245 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:13.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fa3da700 1 --2- 172.21.15.107:0/1274577245 >> v2:172.21.15.195:3300/0 conn(0x7fa0f40ce070 0x7fa0f40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 -- 172.21.15.107:0/1274577245 >> v2:172.21.15.195:3300/0 conn(0x7fa0f40ce070 msgr2=0x7fa0f40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 --2- 172.21.15.107:0/1274577245 >> v2:172.21.15.195:3300/0 conn(0x7fa0f40ce070 0x7fa0f40ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 -- 172.21.15.107:0/1274577245 >> v1:172.21.15.107:6789/0 conn(0x7fa0f415d300 legacy=0x7fa0f40cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 -- 172.21.15.107:0/1274577245 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40cec40 con 0x7fa0f40d0000 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f93d8700 1 --2- 172.21.15.107:0/1274577245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40d0000 0x7fa0f40cdb30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40cf690 tx=0x7fa0f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a1ea9d7ddf2e73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f8bd7700 1 -- 172.21.15.107:0/1274577245 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000b8a0 con 0x7fa0f40d0000 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f8bd7700 1 -- 172.21.15.107:0/1274577245 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000ba00 con 0x7fa0f40d0000 2024-05-08T21:00:13.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0f8bd7700 1 -- 172.21.15.107:0/1274577245 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000bd90 con 0x7fa0f40d0000 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 -- 172.21.15.107:0/1274577245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40d0000 msgr2=0x7fa0f40cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/1274577245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40d0000 0x7fa0f40cdb30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa0f40cf690 tx=0x7fa0f0009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 -- 172.21.15.107:0/1274577245 shutdown_connections 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/1274577245 >> v2:172.21.15.195:3300/0 conn(0x7fa0f40ce070 0x7fa0f40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/1274577245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40d0000 0x7fa0f40cdb30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 -- 172.21.15.107:0/1274577245 >> 172.21.15.107:0/1274577245 conn(0x7fa0f409c3a0 msgr2=0x7fa0f40d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 -- 172.21.15.107:0/1274577245 shutdown_connections 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 -- 172.21.15.107:0/1274577245 wait complete. 2024-05-08T21:00:13.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 Processor -- start 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.388+0000 7fa0fabdb700 1 -- start start 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 0x7fa0f40b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0f40d0000 0x7fa0f414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f415d300 0x7fa0f40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40c6b90 con 0x7fa0f40ce070 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4159b30 con 0x7fa0f415d300 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f40b6cd0 con 0x7fa0f40d0000 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f9bd9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 0x7fa0f40b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f9bd9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 0x7fa0f40b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37444/0 (socket says 172.21.15.107:37444) 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f9bd9700 1 -- 172.21.15.107:0/2774996191 learned_addr learned my addr 172.21.15.107:0/2774996191 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0f40d0000 0x7fa0f414c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fa3da700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f415d300 0x7fa0f40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 -- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f415d300 msgr2=0x7fa0f40b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f415d300 0x7fa0f40b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 -- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 msgr2=0x7fa0f40b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 0x7fa0f40b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 -- 172.21.15.107:0/2774996191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009570 con 0x7fa0f40d0000 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f9bd9700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 0x7fa0f40b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0f93d8700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0f40d0000 0x7fa0f414c620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0016000 tx=0x7fa0f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00036c0 con 0x7fa0f40d0000 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f001f070 con 0x7fa0f40d0000 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f40b6fb0 con 0x7fa0f40d0000 2024-05-08T21:00:13.405 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0003a80 con 0x7fa0f40d0000 2024-05-08T21:00:13.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f40b7570 con 0x7fa0f40d0000 2024-05-08T21:00:13.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.392+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f40684b0 con 0x7fa0f40d0000 2024-05-08T21:00:13.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.396+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0f0021030 con 0x7fa0f40d0000 2024-05-08T21:00:13.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.396+0000 7fa0e67fc700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0d8066730 0x7fa0d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.396+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fa0f0085c60 con 0x7fa0f40d0000 2024-05-08T21:00:13.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.396+0000 7fa0f9bd9700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0d8066730 0x7fa0d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.396+0000 7fa0f9bd9700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0d8066730 0x7fa0d8068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0f415c3d0 tx=0x7fa0e8001080 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.404+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa0f0053010 con 0x7fa0f40d0000 2024-05-08T21:00:13.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.588+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0f40d3c50 con 0x7fa0f40d0000 2024-05-08T21:00:13.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.588+0000 7fa0e67fc700 1 -- 172.21.15.107:0/2774996191 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa0f0056630 con 0x7fa0f40d0000 2024-05-08T21:00:13.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0d8066730 msgr2=0x7fa0d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0d8066730 0x7fa0d8068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa0f415c3d0 tx=0x7fa0e8001080 comp rx=0 tx=0).stop 2024-05-08T21:00:13.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0f40d0000 msgr2=0x7fa0f414c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0f40d0000 0x7fa0f414c620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0016000 tx=0x7fa0f0004770 comp rx=0 tx=0).stop 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 shutdown_connections 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0f415d300 0x7fa0f40b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0d8066730 0x7fa0d8068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0f40d0000 0x7fa0f414c620 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 --2- 172.21.15.107:0/2774996191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0f40ce070 0x7fa0f40b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 >> 172.21.15.107:0/2774996191 conn(0x7fa0f409c3a0 msgr2=0x7fa0f40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:13.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 shutdown_connections 2024-05-08T21:00:13.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.592+0000 7fa0fabdb700 1 -- 172.21.15.107:0/2774996191 wait complete. 2024-05-08T21:00:13.604 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:13.614 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T21:00:13.615 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:13.623 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:13.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 Processor -- start 2024-05-08T21:00:13.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 -- start start 2024-05-08T21:00:13.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14cc0cddf0 0x7f14cc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f14cc0d0bd0 0x7f14cc0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14cc15e830 con 0x7f14cc0cf980 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc0ce2d0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d1c5c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14cc0ce5b0 con 0x7f14cc0d0bd0 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14cc0cddf0 0x7f14cc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14cc0cddf0 0x7f14cc15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37460/0 (socket says 172.21.15.107:37460) 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 -- 172.21.15.107:0/393145537 learned_addr learned my addr 172.21.15.107:0/393145537 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14d145b700 1 --2- 172.21.15.107:0/393145537 >> v2:172.21.15.195:3300/0 conn(0x7f14cc0d0bd0 0x7f14cc0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 -- 172.21.15.107:0/393145537 >> v2:172.21.15.195:3300/0 conn(0x7f14cc0d0bd0 msgr2=0x7f14cc0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 --2- 172.21.15.107:0/393145537 >> v2:172.21.15.195:3300/0 conn(0x7f14cc0d0bd0 0x7f14cc0d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 -- 172.21.15.107:0/393145537 >> v1:172.21.15.195:6789/0 conn(0x7f14cc0cf980 legacy=0x7f14cc0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 -- 172.21.15.107:0/393145537 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc0ce890 con 0x7f14cc0cddf0 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cbfff700 1 --2- 172.21.15.107:0/393145537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc15e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f14cc09c950 tx=0x7f14bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615820b43c373c20 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cb7fe700 1 -- 172.21.15.107:0/393145537 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00e070 con 0x7f14cc0cddf0 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cb7fe700 1 -- 172.21.15.107:0/393145537 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc00b9c0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.724+0000 7f14cb7fe700 1 -- 172.21.15.107:0/393145537 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc00bd70 con 0x7f14cc0cddf0 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- 172.21.15.107:0/393145537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 msgr2=0x7f14cc15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/393145537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc15e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f14cc09c950 tx=0x7f14bc00b330 comp rx=0 tx=0).stop 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- 172.21.15.107:0/393145537 shutdown_connections 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/393145537 >> v2:172.21.15.195:3300/0 conn(0x7f14cc0d0bd0 0x7f14cc0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/393145537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc15e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- 172.21.15.107:0/393145537 >> 172.21.15.107:0/393145537 conn(0x7f14cc09c370 msgr2=0x7f14cc0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- 172.21.15.107:0/393145537 shutdown_connections 2024-05-08T21:00:13.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- 172.21.15.107:0/393145537 wait complete. 2024-05-08T21:00:13.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 Processor -- start 2024-05-08T21:00:13.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- start start 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc1f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc0cf980 0x7f14cc15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14cc0d0bd0 0x7f14cc0a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc15bd80 con 0x7f14cc0cddf0 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0ccb10 con 0x7f14cc0cf980 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d1c5c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc0a0760 con 0x7f14cc0d0bd0 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.728+0000 7f14d0c5a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc1f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc1f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37468/0 (socket says 172.21.15.107:37468) 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 -- 172.21.15.107:0/712009307 learned_addr learned my addr 172.21.15.107:0/712009307 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:13.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14cbfff700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc0cf980 0x7f14cc15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d145b700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14cc0d0bd0 0x7f14cc0a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 -- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14cc0d0bd0 msgr2=0x7f14cc0a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14cc0d0bd0 0x7f14cc0a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 -- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc0cf980 msgr2=0x7f14cc15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc0cf980 0x7f14cc15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 -- 172.21.15.107:0/712009307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009b30 con 0x7f14cc0cddf0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d0c5a700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc1f6e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c500 tx=0x7f14b400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40052d0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4005430 con 0x7f14cc0cddf0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc09cd80 con 0x7f14cc0cddf0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40055a0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc0cc7a0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc09d2a0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14b40038e0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14c97fa700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f14ac066760 0x7f14ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14cbfff700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f14ac066760 0x7f14ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.732+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f14b4083550 con 0x7f14cc0cddf0 2024-05-08T21:00:13.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.736+0000 7f14cbfff700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f14ac066760 0x7f14ac068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0ce200 tx=0x7f14bc009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:13.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.740+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f14cc09d2a0 con 0x7f14cc0cddf0 2024-05-08T21:00:13.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.912+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14cc0cc600 con 0x7f14cc0cddf0 2024-05-08T21:00:13.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14c97fa700 1 -- 172.21.15.107:0/712009307 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f14cc0cc600 con 0x7f14cc0cddf0 2024-05-08T21:00:13.924 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:13.924 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f14ac066760 msgr2=0x7f14ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f14ac066760 0x7f14ac068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0ce200 tx=0x7f14bc009000 comp rx=0 tx=0).stop 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 msgr2=0x7f14cc1f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc1f6e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c500 tx=0x7f14b400c810 comp rx=0 tx=0).stop 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 shutdown_connections 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f14ac066760 0x7f14ac068c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.926 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f14cc0d0bd0 0x7f14cc0a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14cc0cf980 0x7f14cc15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 --2- 172.21.15.107:0/712009307 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14cc0cddf0 0x7f14cc1f6e10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:13.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 >> 172.21.15.107:0/712009307 conn(0x7f14cc09c370 msgr2=0x7f14cc15ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:13.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 shutdown_connections 2024-05-08T21:00:13.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:13.916+0000 7f14d1c5c700 1 -- 172.21.15.107:0/712009307 wait complete. 2024-05-08T21:00:13.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:13.939 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:14.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 Processor -- start 2024-05-08T21:00:14.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 -- start start 2024-05-08T21:00:14.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a2c0d1da0 0x7f3a2c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0cfe80 0x7f3a2c0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c0d3d40 con 0x7f3a2c160920 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0d02d0 con 0x7f3a2c0d1da0 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a33068700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0d0d00 con 0x7f3a2c0cfe80 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.052+0000 7f3a31865700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a2c0d1da0 0x7f3a2c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3a2c0d1da0 0x7f3a2c0cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37474/0 (socket says 172.21.15.107:37474) 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 -- 172.21.15.107:0/2158519214 learned_addr learned my addr 172.21.15.107:0/2158519214 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a32066700 1 --1- 172.21.15.107:0/2158519214 >> v1:172.21.15.107:6789/0 conn(0x7f3a2c160920 0x7f3a2c0ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39560/0 (socket says 172.21.15.107:39560) 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a32867700 1 --2- 172.21.15.107:0/2158519214 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0cfe80 0x7f3a2c0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 -- 172.21.15.107:0/2158519214 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0cfe80 msgr2=0x7f3a2c0b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 --2- 172.21.15.107:0/2158519214 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0cfe80 0x7f3a2c0b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 -- 172.21.15.107:0/2158519214 >> v1:172.21.15.107:6789/0 conn(0x7f3a2c160920 legacy=0x7f3a2c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31064700 1 -- 172.21.15.107:0/2158519214 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485766336 0 0) 0x7f3a2c0d3d40 con 0x7f3a2c160920 2024-05-08T21:00:14.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 -- 172.21.15.107:0/2158519214 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0d0fe0 con 0x7f3a2c0d1da0 2024-05-08T21:00:14.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31865700 1 --2- 172.21.15.107:0/2158519214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cf940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0cd6e0 tx=0x7f3a28009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8fafdb6888e625 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31064700 1 -- 172.21.15.107:0/2158519214 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28011830 con 0x7f3a2c0d1da0 2024-05-08T21:00:14.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31064700 1 -- 172.21.15.107:0/2158519214 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a28011990 con 0x7f3a2c0d1da0 2024-05-08T21:00:14.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a31064700 1 -- 172.21.15.107:0/2158519214 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28011d20 con 0x7f3a2c0d1da0 2024-05-08T21:00:14.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 -- 172.21.15.107:0/2158519214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c0d1da0 msgr2=0x7f3a2c0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 --2- 172.21.15.107:0/2158519214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cf940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0cd6e0 tx=0x7f3a28009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 -- 172.21.15.107:0/2158519214 shutdown_connections 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 --2- 172.21.15.107:0/2158519214 >> v2:172.21.15.195:3300/0 conn(0x7f3a2c0cfe80 0x7f3a2c0b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 --2- 172.21.15.107:0/2158519214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cf940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 -- 172.21.15.107:0/2158519214 >> 172.21.15.107:0/2158519214 conn(0x7f3a2c09c340 msgr2=0x7f3a2c0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 -- 172.21.15.107:0/2158519214 shutdown_connections 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 -- 172.21.15.107:0/2158519214 wait complete. 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 Processor -- start 2024-05-08T21:00:14.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.056+0000 7f3a33068700 1 -- start start 2024-05-08T21:00:14.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cfe80 0x7f3a2c143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 0x7f3a2c0cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c152f90 con 0x7f3a2c160920 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c1436d0 con 0x7f3a2c0d1da0 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c156120 con 0x7f3a2c0cfe80 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 0x7f3a2c0cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 0x7f3a2c0cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37478/0 (socket says 172.21.15.107:37478) 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 -- 172.21.15.107:0/1342194339 learned_addr learned my addr 172.21.15.107:0/1342194339 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a31865700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32066700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cfe80 0x7f3a2c143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 -- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cfe80 msgr2=0x7f3a2c143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cfe80 0x7f3a2c143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 -- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0d1da0 msgr2=0x7f3a2c0cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 -- 172.21.15.107:0/1342194339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a28009570 con 0x7f3a2c160920 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a31865700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a32867700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 0x7f3a2c0cc490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400efc0 tx=0x7f3a2400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400cb80 con 0x7f3a2c160920 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2400f040 con 0x7f3a2c160920 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c1531e0 con 0x7f3a2c160920 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24014480 con 0x7f3a2c160920 2024-05-08T21:00:14.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.060+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c0cbe70 con 0x7f3a2c160920 2024-05-08T21:00:14.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.064+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c0684b0 con 0x7f3a2c160920 2024-05-08T21:00:14.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.064+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a240145e0 con 0x7f3a2c160920 2024-05-08T21:00:14.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.064+0000 7f3a22ffd700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3a10066760 0x7f3a10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.064+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f3a24084aa0 con 0x7f3a2c160920 2024-05-08T21:00:14.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.064+0000 7f3a32066700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3a10066760 0x7f3a10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.064+0000 7f3a32066700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3a10066760 0x7f3a10068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000f60 tx=0x7f3a1c007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.068+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f3a24051c20 con 0x7f3a2c160920 2024-05-08T21:00:14.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.236+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a2c0cf510 con 0x7f3a2c160920 2024-05-08T21:00:14.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.236+0000 7f3a22ffd700 1 -- 172.21.15.107:0/1342194339 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a24018020 con 0x7f3a2c160920 2024-05-08T21:00:14.247 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:14.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3a10066760 msgr2=0x7f3a10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3a10066760 0x7f3a10068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000f60 tx=0x7f3a1c007e90 comp rx=0 tx=0).stop 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 msgr2=0x7f3a2c0cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 0x7f3a2c0cc490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400efc0 tx=0x7f3a2400c0c0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 shutdown_connections 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a2c160920 0x7f3a2c0cc490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a2c0d1da0 0x7f3a2c0cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3a10066760 0x7f3a10068c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 --2- 172.21.15.107:0/1342194339 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f3a2c0cfe80 0x7f3a2c143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 >> 172.21.15.107:0/1342194339 conn(0x7f3a2c09c340 msgr2=0x7f3a2c0ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 shutdown_connections 2024-05-08T21:00:14.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.240+0000 7f3a33068700 1 -- 172.21.15.107:0/1342194339 wait complete. 2024-05-08T21:00:14.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:14.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.372+0000 7f87ee0fd700 1 Processor -- start 2024-05-08T21:00:14.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.372+0000 7f87ee0fd700 1 -- start start 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f87e8157b30 0x7f87e815e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f87e80adf30 0x7f87e80b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e815a350 con 0x7f87e80abda0 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e815e980 con 0x7f87e8157b30 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e815b370 con 0x7f87e80adf30 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ec8fa700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f87e80abda0 0x7f87e80ad820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39576/0 (socket says 172.21.15.107:39576) 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ec8fa700 1 -- 172.21.15.107:0/597119559 learned_addr learned my addr 172.21.15.107:0/597119559 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed0fb700 1 --2- 172.21.15.107:0/597119559 >> v2:172.21.15.107:3300/0 conn(0x7f87e8157b30 0x7f87e815e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed8fc700 1 --2- 172.21.15.107:0/597119559 >> v2:172.21.15.195:3300/0 conn(0x7f87e80adf30 0x7f87e80b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87dffff700 1 -- 172.21.15.107:0/597119559 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217440304 0 0) 0x7f87e815a350 con 0x7f87e80abda0 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87dffff700 1 -- 172.21.15.107:0/597119559 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d40035d0 con 0x7f87e80abda0 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed0fb700 1 -- 172.21.15.107:0/597119559 >> v2:172.21.15.195:3300/0 conn(0x7f87e80adf30 msgr2=0x7f87e80b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:14.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed0fb700 1 --2- 172.21.15.107:0/597119559 >> v2:172.21.15.195:3300/0 conn(0x7f87e80adf30 0x7f87e80b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed0fb700 1 -- 172.21.15.107:0/597119559 >> v1:172.21.15.107:6789/0 conn(0x7f87e80abda0 legacy=0x7f87e80ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed0fb700 1 -- 172.21.15.107:0/597119559 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e815a5b0 con 0x7f87e8157b30 2024-05-08T21:00:14.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ed0fb700 1 --2- 172.21.15.107:0/597119559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e8157b30 0x7f87e815e350 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f87e806dff0 tx=0x7f87d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f150b8d81008a00 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87dffff700 1 -- 172.21.15.107:0/597119559 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8011830 con 0x7f87e8157b30 2024-05-08T21:00:14.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87dffff700 1 -- 172.21.15.107:0/597119559 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8011990 con 0x7f87e8157b30 2024-05-08T21:00:14.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87dffff700 1 -- 172.21.15.107:0/597119559 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8011d20 con 0x7f87e8157b30 2024-05-08T21:00:14.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- 172.21.15.107:0/597119559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e8157b30 msgr2=0x7f87e815e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/597119559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e8157b30 0x7f87e815e350 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f87e806dff0 tx=0x7f87d8009b30 comp rx=0 tx=0).stop 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- 172.21.15.107:0/597119559 shutdown_connections 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/597119559 >> v2:172.21.15.195:3300/0 conn(0x7f87e80adf30 0x7f87e80b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/597119559 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e8157b30 0x7f87e815e350 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- 172.21.15.107:0/597119559 >> 172.21.15.107:0/597119559 conn(0x7f87e80b0de0 msgr2=0x7f87e80b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- 172.21.15.107:0/597119559 shutdown_connections 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- 172.21.15.107:0/597119559 wait complete. 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 Processor -- start 2024-05-08T21:00:14.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.376+0000 7f87ee0fd700 1 -- start start 2024-05-08T21:00:14.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87e80abda0 0x7f87e8152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 0x7f87e8154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87e8157b30 0x7f87e80b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8157330 con 0x7f87e80adf30 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8156a90 con 0x7f87e8157b30 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8156d70 con 0x7f87e80abda0 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 0x7f87e8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 0x7f87e8154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37500/0 (socket says 172.21.15.107:37500) 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 -- 172.21.15.107:0/688130110 learned_addr learned my addr 172.21.15.107:0/688130110 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ed8fc700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87e8157b30 0x7f87e80b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ed0fb700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87e80abda0 0x7f87e8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 -- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87e80abda0 msgr2=0x7f87e8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87e80abda0 0x7f87e8152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 -- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87e8157b30 msgr2=0x7f87e80b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87e8157b30 0x7f87e80b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 -- 172.21.15.107:0/688130110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d80094b0 con 0x7f87e80adf30 2024-05-08T21:00:14.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ec8fa700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 0x7f87e8154910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87e400c700 tx=0x7f87e400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4005d90 con 0x7f87e80adf30 2024-05-08T21:00:14.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e40070d0 con 0x7f87e80adf30 2024-05-08T21:00:14.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4007480 con 0x7f87e80adf30 2024-05-08T21:00:14.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e8157050 con 0x7f87e80adf30 2024-05-08T21:00:14.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.380+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e8152c70 con 0x7f87e80adf30 2024-05-08T21:00:14.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.384+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e81f3eb0 con 0x7f87e80adf30 2024-05-08T21:00:14.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.384+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87e40075e0 con 0x7f87e80adf30 2024-05-08T21:00:14.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.384+0000 7f87ddffb700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f87cc066730 0x7f87cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.384+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f87e4083820 con 0x7f87e80adf30 2024-05-08T21:00:14.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.384+0000 7f87ed0fb700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f87cc066730 0x7f87cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.384+0000 7f87ed0fb700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f87cc066730 0x7f87cc068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87d8000c00 tx=0x7f87d8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.392+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f87e81f3eb0 con 0x7f87e80adf30 2024-05-08T21:00:14.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.560+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87e81f3eb0 con 0x7f87e80adf30 2024-05-08T21:00:14.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.560+0000 7f87ddffb700 1 -- 172.21.15.107:0/688130110 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87e81f3eb0 con 0x7f87e80adf30 2024-05-08T21:00:14.570 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:14.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f87cc066730 msgr2=0x7f87cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f87cc066730 0x7f87cc068bf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87d8000c00 tx=0x7f87d8008030 comp rx=0 tx=0).stop 2024-05-08T21:00:14.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 msgr2=0x7f87e8154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 0x7f87e8154910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f87e400c700 tx=0x7f87e400cac0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 shutdown_connections 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f87e8157b30 0x7f87e80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e80adf30 0x7f87e8154910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f87cc066730 0x7f87cc068bf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 --2- 172.21.15.107:0/688130110 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f87e80abda0 0x7f87e8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 >> 172.21.15.107:0/688130110 conn(0x7f87e80b0de0 msgr2=0x7f87e80b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 shutdown_connections 2024-05-08T21:00:14.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.564+0000 7f87ee0fd700 1 -- 172.21.15.107:0/688130110 wait complete. 2024-05-08T21:00:14.585 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:14.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 Processor -- start 2024-05-08T21:00:14.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 -- start start 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa350157b30 0x7fa35015e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3500adf30 0x7fa3500b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35015a350 con 0x7fa3500abda0 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35015e980 con 0x7fa350157b30 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35690c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35015b370 con 0x7fa3500adf30 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa355109700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa3500abda0 0x7fa3500ad820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39584/0 (socket says 172.21.15.107:39584) 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35590a700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa350157b30 0x7fa35015e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa355109700 1 -- 172.21.15.107:0/1360133894 learned_addr learned my addr 172.21.15.107:0/1360133894 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35610b700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3500adf30 0x7fa3500b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35590a700 1 -- 172.21.15.107:0/1360133894 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3500adf30 msgr2=0x7fa3500b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35590a700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3500adf30 0x7fa3500b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35590a700 1 -- 172.21.15.107:0/1360133894 >> v1:172.21.15.107:6789/0 conn(0x7fa3500abda0 legacy=0x7fa3500ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35590a700 1 -- 172.21.15.107:0/1360133894 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35015a5b0 con 0x7fa350157b30 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35610b700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3500adf30 0x7fa3500b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.700+0000 7fa35590a700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa350157b30 0x7fa35015e350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa340009850 tx=0x7fa340009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d3129f1f8b7457 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa354908700 1 -- 172.21.15.107:0/1360133894 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340011830 con 0x7fa350157b30 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa354908700 1 -- 172.21.15.107:0/1360133894 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340011990 con 0x7fa350157b30 2024-05-08T21:00:14.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa354908700 1 -- 172.21.15.107:0/1360133894 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340011d20 con 0x7fa350157b30 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 -- 172.21.15.107:0/1360133894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa350157b30 msgr2=0x7fa35015e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa350157b30 0x7fa35015e350 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa340009850 tx=0x7fa340009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 -- 172.21.15.107:0/1360133894 shutdown_connections 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa3500adf30 0x7fa3500b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 --2- 172.21.15.107:0/1360133894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa350157b30 0x7fa35015e350 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 -- 172.21.15.107:0/1360133894 >> 172.21.15.107:0/1360133894 conn(0x7fa3500b0de0 msgr2=0x7fa3500b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 -- 172.21.15.107:0/1360133894 shutdown_connections 2024-05-08T21:00:14.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 -- 172.21.15.107:0/1360133894 wait complete. 2024-05-08T21:00:14.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 Processor -- start 2024-05-08T21:00:14.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.704+0000 7fa35690c700 1 -- start start 2024-05-08T21:00:14.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3500abda0 0x7fa35009a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 0x7fa3501454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa350157b30 0x7fa350145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35009a9a0 con 0x7fa3500adf30 2024-05-08T21:00:14.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa350158d50 con 0x7fa3500abda0 2024-05-08T21:00:14.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa350159030 con 0x7fa350157b30 2024-05-08T21:00:14.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 0x7fa3501454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 0x7fa3501454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37514/0 (socket says 172.21.15.107:37514) 2024-05-08T21:00:14.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 -- 172.21.15.107:0/1343853736 learned_addr learned my addr 172.21.15.107:0/1343853736 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:14.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35590a700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3500abda0 0x7fa35009a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35610b700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa350157b30 0x7fa350145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 -- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa350157b30 msgr2=0x7fa350145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa350157b30 0x7fa350145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 -- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3500abda0 msgr2=0x7fa35009a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3500abda0 0x7fa35009a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 -- 172.21.15.107:0/1343853736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400094b0 con 0x7fa3500adf30 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa355109700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 0x7fa3501454e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa34c001eb0 tx=0x7fa34c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c005d90 con 0x7fa3500adf30 2024-05-08T21:00:14.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c0070d0 con 0x7fa3500adf30 2024-05-08T21:00:14.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa350159310 con 0x7fa3500adf30 2024-05-08T21:00:14.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c007440 con 0x7fa3500adf30 2024-05-08T21:00:14.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3501598d0 con 0x7fa3500adf30 2024-05-08T21:00:14.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.708+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa338005310 con 0x7fa3500adf30 2024-05-08T21:00:14.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.712+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa34c0075a0 con 0x7fa3500adf30 2024-05-08T21:00:14.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.712+0000 7fa3467fc700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa334066760 0x7fa334068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:14.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.712+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fa34c083a00 con 0x7fa3500adf30 2024-05-08T21:00:14.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.712+0000 7fa35590a700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa334066760 0x7fa334068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:14.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.712+0000 7fa35590a700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa334066760 0x7fa334068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa340000c00 tx=0x7fa340008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:14.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.716+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa34c050cb0 con 0x7fa3500adf30 2024-05-08T21:00:14.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.884+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa338005b40 con 0x7fa3500adf30 2024-05-08T21:00:14.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.884+0000 7fa3467fc700 1 -- 172.21.15.107:0/1343853736 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa34c017020 con 0x7fa3500adf30 2024-05-08T21:00:14.894 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:14.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa334066760 msgr2=0x7fa334068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa334066760 0x7fa334068c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa340000c00 tx=0x7fa340008030 comp rx=0 tx=0).stop 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 msgr2=0x7fa3501454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 0x7fa3501454e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa34c001eb0 tx=0x7fa34c00c7b0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 shutdown_connections 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa334066760 0x7fa334068c20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa350157b30 0x7fa350145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3500adf30 0x7fa3501454e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 --2- 172.21.15.107:0/1343853736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3500abda0 0x7fa35009a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 >> 172.21.15.107:0/1343853736 conn(0x7fa3500b0de0 msgr2=0x7fa3500b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 shutdown_connections 2024-05-08T21:00:14.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:14.888+0000 7fa35690c700 1 -- 172.21.15.107:0/1343853736 wait complete. 2024-05-08T21:00:14.908 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:15.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 Processor -- start 2024-05-08T21:00:15.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- start start 2024-05-08T21:00:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f750015b180 0x7f75000b0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f75000ce9d0 0x7f75000cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:15.021 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000cd4b0 con 0x7f75000cee40 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000b0b50 con 0x7f750015b180 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000cc5c0 con 0x7f75000ce9d0 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f750015b180 0x7f75000b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f750015b180 0x7f75000b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37516/0 (socket says 172.21.15.107:37516) 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 -- 172.21.15.107:0/807436347 learned_addr learned my addr 172.21.15.107:0/807436347 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7504a32700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f75000cee40 0x7f75000cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:39588/0 (socket says 172.21.15.107:39588) 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74ff7fe700 1 --2- 172.21.15.107:0/807436347 >> v2:172.21.15.195:3300/0 conn(0x7f75000ce9d0 0x7f75000cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 -- 172.21.15.107:0/807436347 >> v2:172.21.15.195:3300/0 conn(0x7f75000ce9d0 msgr2=0x7f75000cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 --2- 172.21.15.107:0/807436347 >> v2:172.21.15.195:3300/0 conn(0x7f75000ce9d0 0x7f75000cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 -- 172.21.15.107:0/807436347 >> v1:172.21.15.107:6789/0 conn(0x7f75000cee40 legacy=0x7f75000cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 -- 172.21.15.107:0/807436347 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000cc8a0 con 0x7f750015b180 2024-05-08T21:00:15.022 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74fffff700 1 --2- 172.21.15.107:0/807436347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f750015b180 0x7f75000b0610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75000714a0 tx=0x7f74e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ce42e405dbc0f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:15.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74feffd700 1 -- 172.21.15.107:0/807436347 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011830 con 0x7f750015b180 2024-05-08T21:00:15.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74feffd700 1 -- 172.21.15.107:0/807436347 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e8011990 con 0x7f750015b180 2024-05-08T21:00:15.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f74feffd700 1 -- 172.21.15.107:0/807436347 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011d20 con 0x7f750015b180 2024-05-08T21:00:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- 172.21.15.107:0/807436347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f750015b180 msgr2=0x7f75000b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 --2- 172.21.15.107:0/807436347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f750015b180 0x7f75000b0610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75000714a0 tx=0x7f74e8009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- 172.21.15.107:0/807436347 shutdown_connections 2024-05-08T21:00:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 --2- 172.21.15.107:0/807436347 >> v2:172.21.15.195:3300/0 conn(0x7f75000ce9d0 0x7f75000cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 --2- 172.21.15.107:0/807436347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f750015b180 0x7f75000b0610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- 172.21.15.107:0/807436347 >> 172.21.15.107:0/807436347 conn(0x7f75000b2970 msgr2=0x7f75000b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- 172.21.15.107:0/807436347 shutdown_connections 2024-05-08T21:00:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.012+0000 7f7505233700 1 -- 172.21.15.107:0/807436347 wait complete. 2024-05-08T21:00:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 Processor -- start 2024-05-08T21:00:15.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 -- start start 2024-05-08T21:00:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 0x7f75000c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:15.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75000cee40 0x7f750015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750015b180 0x7f750014c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000ca1c0 con 0x7f75000ce9d0 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75000c8ec0 con 0x7f75000cee40 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75000c9890 con 0x7f750015b180 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 0x7f75000c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 0x7f75000c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37520/0 (socket says 172.21.15.107:37520) 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 -- 172.21.15.107:0/3373401387 learned_addr learned my addr 172.21.15.107:0/3373401387 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:15.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74ff7fe700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75000cee40 0x7f750015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7504a32700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750015b180 0x7f750014c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 -- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750015b180 msgr2=0x7f750014c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750015b180 0x7f750014c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 -- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75000cee40 msgr2=0x7f750015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75000cee40 0x7f750015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 -- 172.21.15.107:0/3373401387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e8009570 con 0x7f75000ce9d0 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fffff700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 0x7f75000c88b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f74e8000c00 tx=0x7f74e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:15.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e8004610 con 0x7f75000ce9d0 2024-05-08T21:00:15.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e801e070 con 0x7f75000ce9d0 2024-05-08T21:00:15.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75000c9b70 con 0x7f75000ce9d0 2024-05-08T21:00:15.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e80038e0 con 0x7f75000ce9d0 2024-05-08T21:00:15.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.016+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750014c720 con 0x7f75000ce9d0 2024-05-08T21:00:15.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.020+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000d0360 con 0x7f75000ce9d0 2024-05-08T21:00:15.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.020+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74e8003a40 con 0x7f75000ce9d0 2024-05-08T21:00:15.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.020+0000 7f74fcff9700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f74e4066730 0x7f74e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:15.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.020+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f74e8084ea0 con 0x7f75000ce9d0 2024-05-08T21:00:15.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.020+0000 7f74ff7fe700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f74e4066730 0x7f74e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:15.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.024+0000 7f74ff7fe700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f74e4066730 0x7f74e4068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f750009efa0 tx=0x7f74f000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:15.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.024+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f74e80521c0 con 0x7f75000ce9d0 2024-05-08T21:00:15.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.208+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75000672a0 con 0x7f75000ce9d0 2024-05-08T21:00:15.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.208+0000 7f74fcff9700 1 -- 172.21.15.107:0/3373401387 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74e8020080 con 0x7f75000ce9d0 2024-05-08T21:00:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f74e4066730 msgr2=0x7f74e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f74e4066730 0x7f74e4068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f750009efa0 tx=0x7f74f000b040 comp rx=0 tx=0).stop 2024-05-08T21:00:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 msgr2=0x7f75000c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:15.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 0x7f75000c88b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f74e8000c00 tx=0x7f74e8004770 comp rx=0 tx=0).stop 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 shutdown_connections 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f74e4066730 0x7f74e4068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f750015b180 0x7f750014c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75000cee40 0x7f750015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 --2- 172.21.15.107:0/3373401387 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75000ce9d0 0x7f75000c88b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 >> 172.21.15.107:0/3373401387 conn(0x7f75000b2970 msgr2=0x7f750006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 shutdown_connections 2024-05-08T21:00:15.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:15.212+0000 7f7505233700 1 -- 172.21.15.107:0/3373401387 wait complete. 2024-05-08T21:00:15.222 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:15.232 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2024-05-08T21:00:15.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:15.232 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-08T21:00:15.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi195.stderr:ceph-fuse[31698]: fuse finished with error 0 and tester_r 0 2024-05-08T21:00:15.270 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:00:21.372 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:00:21.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:21.372 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-08T21:00:21.392 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T21:00:21.392 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:21.442 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T21:00:21.442 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:21.450 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:21.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 Processor -- start 2024-05-08T21:00:21.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 -- start start 2024-05-08T21:00:21.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9640b3c20 0x7fd9641624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd964070110 0x7fd9640705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd964158960 con 0x7fd964071e70 2024-05-08T21:00:21.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9640b1f60 con 0x7fd9640b3c20 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.568+0000 7fd9699a5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640ae990 con 0x7fd964070110 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9640b3c20 0x7fd9641624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd9640b3c20 0x7fd9641624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37792/0 (socket says 172.21.15.107:37792) 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 -- 172.21.15.107:0/1811569312 learned_addr learned my addr 172.21.15.107:0/1811569312 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9691a4700 1 --2- 172.21.15.107:0/1811569312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd964070110 0x7fd9640705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 -- 172.21.15.107:0/1811569312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd964070110 msgr2=0x7fd9640705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 --2- 172.21.15.107:0/1811569312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd964070110 0x7fd9640705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 -- 172.21.15.107:0/1811569312 >> v1:172.21.15.195:6789/0 conn(0x7fd964071e70 legacy=0x7fd9640b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 -- 172.21.15.107:0/1811569312 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640b2170 con 0x7fd9640b3c20 2024-05-08T21:00:21.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9689a3700 1 --2- 172.21.15.107:0/1811569312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9640b3c20 0x7fd9641624b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd958009910 tx=0x7fd958009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbd8f6dcf332c1e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9637fe700 1 -- 172.21.15.107:0/1811569312 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800ba60 con 0x7fd9640b3c20 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9637fe700 1 -- 172.21.15.107:0/1811569312 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95800bbc0 con 0x7fd9640b3c20 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9637fe700 1 -- 172.21.15.107:0/1811569312 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958009e60 con 0x7fd9640b3c20 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 -- 172.21.15.107:0/1811569312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9640b3c20 msgr2=0x7fd9641624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 --2- 172.21.15.107:0/1811569312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9640b3c20 0x7fd9641624b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd958009910 tx=0x7fd958009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 -- 172.21.15.107:0/1811569312 shutdown_connections 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 --2- 172.21.15.107:0/1811569312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd964070110 0x7fd9640705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 --2- 172.21.15.107:0/1811569312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9640b3c20 0x7fd9641624b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 -- 172.21.15.107:0/1811569312 >> 172.21.15.107:0/1811569312 conn(0x7fd96406c330 msgr2=0x7fd96406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 -- 172.21.15.107:0/1811569312 shutdown_connections 2024-05-08T21:00:21.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.572+0000 7fd9699a5700 1 -- 172.21.15.107:0/1811569312 wait complete. 2024-05-08T21:00:21.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 Processor -- start 2024-05-08T21:00:21.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 -- start start 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd964070110 0x7fd964145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 0x7fd9640afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9640b3c20 0x7fd9640b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964143d40 con 0x7fd964071e70 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9641457b0 con 0x7fd964070110 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9699a5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964146620 con 0x7fd9640b3c20 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd963fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 0x7fd9640afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd963fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 0x7fd9640afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37802/0 (socket says 172.21.15.107:37802) 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9691a4700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9640b3c20 0x7fd9640b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd963fff700 1 -- 172.21.15.107:0/2493623728 learned_addr learned my addr 172.21.15.107:0/2493623728 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.576+0000 7fd9689a3700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd964070110 0x7fd964145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd963fff700 1 -- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9640b3c20 msgr2=0x7fd9640b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd963fff700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9640b3c20 0x7fd9640b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd963fff700 1 -- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd964070110 msgr2=0x7fd964145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd963fff700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd964070110 0x7fd964145d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd963fff700 1 -- 172.21.15.107:0/2493623728 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958009570 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd963fff700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 0x7fd9640afec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c500 tx=0x7fd95400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540052d0 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd964146900 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954005430 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540055a0 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964143fe0 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640684b0 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9540038e0 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.580+0000 7fd9617fa700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd950066730 0x7fd950068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.584+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fd9540835f0 con 0x7fd964071e70 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.584+0000 7fd9689a3700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd950066730 0x7fd950068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.584+0000 7fd9689a3700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd950066730 0x7fd950068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd958000c00 tx=0x7fd958008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:21.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.588+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd954050810 con 0x7fd964071e70 2024-05-08T21:00:21.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.760+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd964161550 con 0x7fd964071e70 2024-05-08T21:00:21.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9617fa700 1 -- 172.21.15.107:0/2493623728 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7fd954053e30 con 0x7fd964071e70 2024-05-08T21:00:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:21.772 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:21.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd950066730 msgr2=0x7fd950068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd950066730 0x7fd950068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd958000c00 tx=0x7fd958008030 comp rx=0 tx=0).stop 2024-05-08T21:00:21.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 msgr2=0x7fd9640afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 0x7fd9640afec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c500 tx=0x7fd95400c810 comp rx=0 tx=0).stop 2024-05-08T21:00:21.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 shutdown_connections 2024-05-08T21:00:21.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd950066730 0x7fd950068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9640b3c20 0x7fd9640b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd964071e70 0x7fd9640afec0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 --2- 172.21.15.107:0/2493623728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd964070110 0x7fd964145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 >> 172.21.15.107:0/2493623728 conn(0x7fd96406c330 msgr2=0x7fd9640b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:21.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 shutdown_connections 2024-05-08T21:00:21.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.764+0000 7fd9699a5700 1 -- 172.21.15.107:0/2493623728 wait complete. 2024-05-08T21:00:21.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:21.787 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:21.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 Processor -- start 2024-05-08T21:00:21.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 -- start start 2024-05-08T21:00:21.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f2988161470 0x7f29880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f298806c380 0x7f2988071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880b3820 con 0x7f2988071880 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2988071c90 con 0x7f298806c380 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2987fff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2988070d20 con 0x7f2988161470 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f298806c380 0x7f2988071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f298806c380 0x7f2988071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37806/0 (socket says 172.21.15.107:37806) 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 -- 172.21.15.107:0/4220314095 learned_addr learned my addr 172.21.15.107:0/4220314095 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2986ffd700 1 --2- 172.21.15.107:0/4220314095 >> v2:172.21.15.195:3300/0 conn(0x7f2988161470 0x7f29880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 -- 172.21.15.107:0/4220314095 >> v2:172.21.15.195:3300/0 conn(0x7f2988161470 msgr2=0x7f29880b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 --2- 172.21.15.107:0/4220314095 >> v2:172.21.15.195:3300/0 conn(0x7f2988161470 0x7f29880b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2985ffb700 1 -- 172.21.15.107:0/4220314095 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38961436 0 0) 0x7f2980001490 con 0x7f2988071880 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 -- 172.21.15.107:0/4220314095 >> v1:172.21.15.107:6789/0 conn(0x7f2988071880 legacy=0x7f29880ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 -- 172.21.15.107:0/4220314095 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988071000 con 0x7f298806c380 2024-05-08T21:00:21.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f29867fc700 1 --2- 172.21.15.107:0/4220314095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f298806c380 0x7f2988071340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f298806e1e0 tx=0x7f2978009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646c1d84da5d050d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2985ffb700 1 -- 172.21.15.107:0/4220314095 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011830 con 0x7f298806c380 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2985ffb700 1 -- 172.21.15.107:0/4220314095 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2978011990 con 0x7f298806c380 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.904+0000 7f2985ffb700 1 -- 172.21.15.107:0/4220314095 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978011d20 con 0x7f298806c380 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/4220314095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f298806c380 msgr2=0x7f2988071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 --2- 172.21.15.107:0/4220314095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f298806c380 0x7f2988071340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f298806e1e0 tx=0x7f2978009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/4220314095 shutdown_connections 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 --2- 172.21.15.107:0/4220314095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f298806c380 0x7f2988071340 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 --2- 172.21.15.107:0/4220314095 >> v2:172.21.15.195:3300/0 conn(0x7f2988161470 0x7f29880b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/4220314095 >> 172.21.15.107:0/4220314095 conn(0x7f29880b0de0 msgr2=0x7f29880b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/4220314095 shutdown_connections 2024-05-08T21:00:21.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/4220314095 wait complete. 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 Processor -- start 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- start start 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 0x7f298814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2988161470 0x7f298809b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f298809b760 0x7f29880ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880cbe50 con 0x7f2988071880 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880cc410 con 0x7f2988161470 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298809bdc0 con 0x7f298809b760 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 0x7f298814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 0x7f298814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37812/0 (socket says 172.21.15.107:37812) 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 -- 172.21.15.107:0/1450450028 learned_addr learned my addr 172.21.15.107:0/1450450028 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:21.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f29867fc700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2988161470 0x7f298809b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f29877fe700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f298809b760 0x7f29880ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 -- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f298809b760 msgr2=0x7f29880ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f298809b760 0x7f29880ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 -- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2988161470 msgr2=0x7f298809b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2988161470 0x7f298809b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 -- 172.21.15.107:0/1450450028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978009570 con 0x7f2988071880 2024-05-08T21:00:21.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2986ffd700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 0x7f298814acc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f297000ea00 tx=0x7f297000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970009720 con 0x7f2988071880 2024-05-08T21:00:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297000c850 con 0x7f2988071880 2024-05-08T21:00:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298809c0a0 con 0x7f2988071880 2024-05-08T21:00:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000cbc0 con 0x7f2988071880 2024-05-08T21:00:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.908+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988158150 con 0x7f2988071880 2024-05-08T21:00:21.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.912+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298809bb70 con 0x7f2988071880 2024-05-08T21:00:21.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.912+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f297000cd20 con 0x7f2988071880 2024-05-08T21:00:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.912+0000 7f297f7fe700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2968066730 0x7f2968068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.912+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f29700843f0 con 0x7f2988071880 2024-05-08T21:00:21.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.912+0000 7f29867fc700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2968066730 0x7f2968068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:21.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.916+0000 7f29867fc700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2968066730 0x7f2968068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f298806c760 tx=0x7f2978008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:21.927 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:21.920+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2970051600 con 0x7f2988071880 2024-05-08T21:00:22.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.088+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29880684b0 con 0x7f2988071880 2024-05-08T21:00:22.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.088+0000 7f297f7fe700 1 -- 172.21.15.107:0/1450450028 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2970054c20 con 0x7f2988071880 2024-05-08T21:00:22.097 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2968066730 msgr2=0x7f2968068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2968066730 0x7f2968068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f298806c760 tx=0x7f2978008030 comp rx=0 tx=0).stop 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 msgr2=0x7f298814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 0x7f298814acc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f297000ea00 tx=0x7f297000edc0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 shutdown_connections 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2968066730 0x7f2968068bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f298809b760 0x7f29880ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2988161470 0x7f298809b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 --2- 172.21.15.107:0/1450450028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2988071880 0x7f298814acc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 >> 172.21.15.107:0/1450450028 conn(0x7f29880b0de0 msgr2=0x7f298815efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:22.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 shutdown_connections 2024-05-08T21:00:22.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.092+0000 7f2987fff700 1 -- 172.21.15.107:0/1450450028 wait complete. 2024-05-08T21:00:22.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:22.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f715dfa5700 1 Processor -- start 2024-05-08T21:00:22.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f715dfa5700 1 -- start start 2024-05-08T21:00:22.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f715dfa5700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f71580d1da0 0x7f71580cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f715dfa5700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71580d3d40 con 0x7f71580cfe80 2024-05-08T21:00:22.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f715dfa5700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71580d02d0 con 0x7f7158160920 2024-05-08T21:00:22.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f715dfa5700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71580d0d00 con 0x7f71580d1da0 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f7157fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f71580d1da0 0x7f71580cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f7157fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f71580d1da0 0x7f71580cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37828/0 (socket says 172.21.15.107:37828) 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f7157fff700 1 -- 172.21.15.107:0/1461253813 learned_addr learned my addr 172.21.15.107:0/1461253813 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f7157fff700 1 -- 172.21.15.107:0/1461253813 >> v1:172.21.15.195:6789/0 conn(0x7f7158160920 legacy=0x7f71580ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f7157fff700 1 -- 172.21.15.107:0/1461253813 >> v1:172.21.15.107:6789/0 conn(0x7f71580cfe80 legacy=0x7f71580b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.228+0000 7f7157fff700 1 -- 172.21.15.107:0/1461253813 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71580d0fe0 con 0x7f71580d1da0 2024-05-08T21:00:22.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f7157fff700 1 --2- 172.21.15.107:0/1461253813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71580d1da0 0x7f71580cf940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7148009910 tx=0x7f7148009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fdd5294b7754d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f71577fe700 1 -- 172.21.15.107:0/1461253813 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714800ba60 con 0x7f71580d1da0 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f71577fe700 1 -- 172.21.15.107:0/1461253813 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714800bbc0 con 0x7f71580d1da0 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f71577fe700 1 -- 172.21.15.107:0/1461253813 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148009e60 con 0x7f71580d1da0 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- 172.21.15.107:0/1461253813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71580d1da0 msgr2=0x7f71580cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 --2- 172.21.15.107:0/1461253813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71580d1da0 0x7f71580cf940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7148009910 tx=0x7f7148009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- 172.21.15.107:0/1461253813 shutdown_connections 2024-05-08T21:00:22.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 --2- 172.21.15.107:0/1461253813 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71580d1da0 0x7f71580cf940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- 172.21.15.107:0/1461253813 >> 172.21.15.107:0/1461253813 conn(0x7f715809c340 msgr2=0x7f71580d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- 172.21.15.107:0/1461253813 shutdown_connections 2024-05-08T21:00:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- 172.21.15.107:0/1461253813 wait complete. 2024-05-08T21:00:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 Processor -- start 2024-05-08T21:00:22.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- start start 2024-05-08T21:00:22.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71580cfe80 0x7f715815cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71580d1da0 0x7f715814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 0x7f715815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715815e2d0 con 0x7f7158160920 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715815d650 con 0x7f71580d1da0 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715dfa5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715815d930 con 0x7f71580cfe80 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715d7a4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 0x7f715815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715d7a4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 0x7f715815f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37834/0 (socket says 172.21.15.107:37834) 2024-05-08T21:00:22.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715d7a4700 1 -- 172.21.15.107:0/254476744 learned_addr learned my addr 172.21.15.107:0/254476744 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715cfa3700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71580cfe80 0x7f715815cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f7157fff700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71580d1da0 0x7f715814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.232+0000 7f715d7a4700 1 -- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71580cfe80 msgr2=0x7f715815cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715d7a4700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71580cfe80 0x7f715815cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715d7a4700 1 -- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71580d1da0 msgr2=0x7f715814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715d7a4700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71580d1da0 0x7f715814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715d7a4700 1 -- 172.21.15.107:0/254476744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009570 con 0x7f7158160920 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f7157fff700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71580d1da0 0x7f715814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715d7a4700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 0x7f715815f1d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f715000cb50 tx=0x7f715000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7150003c20 con 0x7f7158160920 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7150003d80 con 0x7f7158160920 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715815dc10 con 0x7f7158160920 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715000aac0 con 0x7f7158160920 2024-05-08T21:00:22.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715815e6f0 con 0x7f7158160920 2024-05-08T21:00:22.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715815e410 con 0x7f7158160920 2024-05-08T21:00:22.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.236+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f715000ac20 con 0x7f7158160920 2024-05-08T21:00:22.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.240+0000 7f71557fa700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7144066760 0x7f7144068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.240+0000 7f715cfa3700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7144066760 0x7f7144068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.240+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f7150084150 con 0x7f7158160920 2024-05-08T21:00:22.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.240+0000 7f715cfa3700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7144066760 0x7f7144068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f714c000f60 tx=0x7f714c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.244+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f715815e410 con 0x7f7158160920 2024-05-08T21:00:22.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.416+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f715815e410 con 0x7f7158160920 2024-05-08T21:00:22.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.416+0000 7f71557fa700 1 -- 172.21.15.107:0/254476744 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f715815e410 con 0x7f7158160920 2024-05-08T21:00:22.427 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7144066760 msgr2=0x7f7144068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7144066760 0x7f7144068c20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f714c000f60 tx=0x7f714c009040 comp rx=0 tx=0).stop 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 msgr2=0x7f715815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 0x7f715815f1d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f715000cb50 tx=0x7f715000ce60 comp rx=0 tx=0).stop 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 shutdown_connections 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7158160920 0x7f715815f1d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71580d1da0 0x7f715814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7144066760 0x7f7144068c20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 --2- 172.21.15.107:0/254476744 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f71580cfe80 0x7f715815cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 >> 172.21.15.107:0/254476744 conn(0x7f715809c340 msgr2=0x7f71580d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:22.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 shutdown_connections 2024-05-08T21:00:22.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.420+0000 7f715dfa5700 1 -- 172.21.15.107:0/254476744 wait complete. 2024-05-08T21:00:22.441 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:22.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.548+0000 7f128082c700 1 Processor -- start 2024-05-08T21:00:22.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.548+0000 7f128082c700 1 -- start start 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f128082c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f127c159530 0x7f127c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f128082c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 0x7f127c06b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f128082c700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c06d3f0 con 0x7f127c06b8b0 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f128082c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c06bd20 con 0x7f127c159530 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f128082c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c06d6d0 con 0x7f127c06ce90 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 0x7f127c06b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f127b7fe700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f127c159530 0x7f127c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 0x7f127c06b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41590/0 (socket says 172.21.15.107:41590) 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 -- 172.21.15.107:0/2925184384 learned_addr learned my addr 172.21.15.107:0/2925184384 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f127bfff700 1 --1- 172.21.15.107:0/2925184384 >> v1:172.21.15.195:6789/0 conn(0x7f127c06b8b0 0x7f127c0b2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:56372/0 (socket says 172.21.15.107:56372) 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 -- 172.21.15.107:0/2925184384 >> v2:172.21.15.195:3300/0 conn(0x7f127c159530 msgr2=0x7f127c06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 --2- 172.21.15.107:0/2925184384 >> v2:172.21.15.195:3300/0 conn(0x7f127c159530 0x7f127c06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.562 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 -- 172.21.15.107:0/2925184384 >> v1:172.21.15.195:6789/0 conn(0x7f127c06b8b0 legacy=0x7f127c0b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 -- 172.21.15.107:0/2925184384 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c06d9b0 con 0x7f127c06ce90 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.552+0000 7f1273fff700 1 --2- 172.21.15.107:0/2925184384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 0x7f127c06b370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1264009910 tx=0x7f1264009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf78fe78e36c436 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f127affd700 1 -- 172.21.15.107:0/2925184384 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400b830 con 0x7f127c06ce90 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f127affd700 1 -- 172.21.15.107:0/2925184384 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126400b990 con 0x7f127c06ce90 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f127affd700 1 -- 172.21.15.107:0/2925184384 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126400bd40 con 0x7f127c06ce90 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- 172.21.15.107:0/2925184384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 msgr2=0x7f127c06b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 --2- 172.21.15.107:0/2925184384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 0x7f127c06b370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1264009910 tx=0x7f1264009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- 172.21.15.107:0/2925184384 shutdown_connections 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 --2- 172.21.15.107:0/2925184384 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06ce90 0x7f127c06b370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 --2- 172.21.15.107:0/2925184384 >> v2:172.21.15.195:3300/0 conn(0x7f127c159530 0x7f127c06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- 172.21.15.107:0/2925184384 >> 172.21.15.107:0/2925184384 conn(0x7f127c0708f0 msgr2=0x7f127c070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:22.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- 172.21.15.107:0/2925184384 shutdown_connections 2024-05-08T21:00:22.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- 172.21.15.107:0/2925184384 wait complete. 2024-05-08T21:00:22.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 Processor -- start 2024-05-08T21:00:22.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- start start 2024-05-08T21:00:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06b8b0 0x7f127c0a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f127c06ce90 0x7f127c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 0x7f127c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0a9850 con 0x7f127c159530 2024-05-08T21:00:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0ae360 con 0x7f127c06ce90 2024-05-08T21:00:22.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f128082c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0a8c40 con 0x7f127c06b8b0 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.556+0000 7f127bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 0x7f127c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 0x7f127c15bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37846/0 (socket says 172.21.15.107:37846) 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 -- 172.21.15.107:0/3094500647 learned_addr learned my addr 172.21.15.107:0/3094500647 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1273fff700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f127c06ce90 0x7f127c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127b7fe700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06b8b0 0x7f127c0a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 -- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06b8b0 msgr2=0x7f127c0a9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06b8b0 0x7f127c0a9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 -- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f127c06ce90 msgr2=0x7f127c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f127c06ce90 0x7f127c148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 -- 172.21.15.107:0/3094500647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009570 con 0x7f127c159530 2024-05-08T21:00:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f127bfff700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 0x7f127c15bd40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f127400cbd0 tx=0x7f127400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400aa60 con 0x7f127c159530 2024-05-08T21:00:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0a8f20 con 0x7f127c159530 2024-05-08T21:00:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400abe0 con 0x7f127c159530 2024-05-08T21:00:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274007070 con 0x7f127c159530 2024-05-08T21:00:22.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c0a94e0 con 0x7f127c159530 2024-05-08T21:00:22.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c0a99c0 con 0x7f127c159530 2024-05-08T21:00:22.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12740071d0 con 0x7f127c159530 2024-05-08T21:00:22.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1278ff9700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f125c066760 0x7f125c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.560+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f1274084070 con 0x7f127c159530 2024-05-08T21:00:22.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.564+0000 7f127b7fe700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f125c066760 0x7f125c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.571 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.564+0000 7f127b7fe700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f125c066760 0x7f125c068c20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f126c009b50 tx=0x7f126c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.572+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1274051200 con 0x7f127c159530 2024-05-08T21:00:22.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.736+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f127c0672a0 con 0x7f127c159530 2024-05-08T21:00:22.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.740+0000 7f1278ff9700 1 -- 172.21.15.107:0/3094500647 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12740170a0 con 0x7f127c159530 2024-05-08T21:00:22.748 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f125c066760 msgr2=0x7f125c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f125c066760 0x7f125c068c20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f126c009b50 tx=0x7f126c009240 comp rx=0 tx=0).stop 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 msgr2=0x7f127c15bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 0x7f127c15bd40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f127400cbd0 tx=0x7f127400cee0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 shutdown_connections 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f127c159530 0x7f127c15bd40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f127c06ce90 0x7f127c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f125c066760 0x7f125c068c20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 --2- 172.21.15.107:0/3094500647 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f127c06b8b0 0x7f127c0a9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 >> 172.21.15.107:0/3094500647 conn(0x7f127c0708f0 msgr2=0x7f127c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:22.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 shutdown_connections 2024-05-08T21:00:22.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.744+0000 7f128082c700 1 -- 172.21.15.107:0/3094500647 wait complete. 2024-05-08T21:00:22.768 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:22.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77831f4700 1 Processor -- start 2024-05-08T21:00:22.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77831f4700 1 -- start start 2024-05-08T21:00:22.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77831f4700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f777c0b2dd0 0x7f777c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77831f4700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c0af8b0 con 0x7f777c0ad2f0 2024-05-08T21:00:22.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77831f4700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c0b3240 con 0x7f777c06dcc0 2024-05-08T21:00:22.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77831f4700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777c0b3490 con 0x7f777c0b2dd0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77819f1700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f777c0b2dd0 0x7f777c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77829f3700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f777c0ad2f0 0x7f777c163970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56264/0 (socket says 172.21.15.107:56264) 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77829f3700 1 -- 172.21.15.107:0/2312034096 learned_addr learned my addr 172.21.15.107:0/2312034096 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77819f1700 1 -- 172.21.15.107:0/2312034096 >> v1:172.21.15.195:6789/0 conn(0x7f777c06dcc0 legacy=0x7f777c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77819f1700 1 -- 172.21.15.107:0/2312034096 >> v1:172.21.15.107:6789/0 conn(0x7f777c0ad2f0 legacy=0x7f777c163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77819f1700 1 -- 172.21.15.107:0/2312034096 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c0b3770 con 0x7f777c0b2dd0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77811f0700 1 -- 172.21.15.107:0/2312034096 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475278219 0 0) 0x7f777c0af8b0 con 0x7f777c0ad2f0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77819f1700 1 --2- 172.21.15.107:0/2312034096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c0acdb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f776c009850 tx=0x7f776c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286ad45559898c53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77811f0700 1 -- 172.21.15.107:0/2312034096 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c011830 con 0x7f777c0b2dd0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77811f0700 1 -- 172.21.15.107:0/2312034096 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c011990 con 0x7f777c0b2dd0 2024-05-08T21:00:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.872+0000 7f77811f0700 1 -- 172.21.15.107:0/2312034096 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c011d20 con 0x7f777c0b2dd0 2024-05-08T21:00:22.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 -- 172.21.15.107:0/2312034096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 msgr2=0x7f777c0acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 --2- 172.21.15.107:0/2312034096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c0acdb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f776c009850 tx=0x7f776c009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:22.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 -- 172.21.15.107:0/2312034096 shutdown_connections 2024-05-08T21:00:22.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 --2- 172.21.15.107:0/2312034096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c0acdb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 -- 172.21.15.107:0/2312034096 >> 172.21.15.107:0/2312034096 conn(0x7f777c06b470 msgr2=0x7f777c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:22.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 -- 172.21.15.107:0/2312034096 shutdown_connections 2024-05-08T21:00:22.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 -- 172.21.15.107:0/2312034096 wait complete. 2024-05-08T21:00:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 Processor -- start 2024-05-08T21:00:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.876+0000 7f77831f4700 1 -- start start 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f777c06dcc0 0x7f777c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f777c0ad2f0 0x7f777c14bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c14c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c151df0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c1511e0 con 0x7f777c0ad2f0 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c1514c0 con 0x7f777c06dcc0 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c14c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c14c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37858/0 (socket says 172.21.15.107:37858) 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 -- 172.21.15.107:0/294534866 learned_addr learned my addr 172.21.15.107:0/294534866 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77819f1700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f777c0ad2f0 0x7f777c14bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77821f2700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f777c06dcc0 0x7f777c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 -- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f777c06dcc0 msgr2=0x7f777c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f777c06dcc0 0x7f777c152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 -- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f777c0ad2f0 msgr2=0x7f777c14bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f777c0ad2f0 0x7f777c14bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 -- 172.21.15.107:0/294534866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0094b0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77829f3700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c14c440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7774002230 tx=0x7f777400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400aac0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f777400ac40 con 0x7f777c0b2dd0 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c1517a0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740070d0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.880+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c150eb0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.884+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c151f60 con 0x7f777c0b2dd0 2024-05-08T21:00:22.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.884+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7774007250 con 0x7f777c0b2dd0 2024-05-08T21:00:22.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.884+0000 7f7772ffd700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7760066730 0x7f7760068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:22.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.884+0000 7f77821f2700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7760066730 0x7f7760068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:22.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.884+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f7774083fd0 con 0x7f777c0b2dd0 2024-05-08T21:00:22.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.884+0000 7f77821f2700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7760066730 0x7f7760068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7778000f60 tx=0x7f7778009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:22.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:22.888+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f7774051270 con 0x7f777c0b2dd0 2024-05-08T21:00:23.077 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.068+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f777c0684b0 con 0x7f777c0b2dd0 2024-05-08T21:00:23.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.068+0000 7f7772ffd700 1 -- 172.21.15.107:0/294534866 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7774054890 con 0x7f777c0b2dd0 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7760066730 msgr2=0x7f7760068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7760066730 0x7f7760068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7778000f60 tx=0x7f7778009040 comp rx=0 tx=0).stop 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 msgr2=0x7f777c14c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c14c440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7774002230 tx=0x7f777400cf50 comp rx=0 tx=0).stop 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 shutdown_connections 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f777c0b2dd0 0x7f777c14c440 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f777c0ad2f0 0x7f777c14bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7760066730 0x7f7760068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 --2- 172.21.15.107:0/294534866 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f777c06dcc0 0x7f777c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 >> 172.21.15.107:0/294534866 conn(0x7f777c06b470 msgr2=0x7f777c0ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:23.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 shutdown_connections 2024-05-08T21:00:23.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.072+0000 7f77831f4700 1 -- 172.21.15.107:0/294534866 wait complete. 2024-05-08T21:00:23.082 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:23.093 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-05-08T21:00:23.094 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T21:00:23.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:23.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.204+0000 7f67ff59e700 1 Processor -- start 2024-05-08T21:00:23.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.204+0000 7f67ff59e700 1 -- start start 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f68001596a0 0x7f68000b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f680015a190 0x7f68000709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000b3590 con 0x7f68000b4e50 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68000b24f0 con 0x7f68001596a0 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68000b27d0 con 0x7f680015a190 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fdd9b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f68000b4e50 0x7f6800159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56268/0 (socket says 172.21.15.107:56268) 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fdd9b700 1 -- 172.21.15.107:0/2340508968 learned_addr learned my addr 172.21.15.107:0/2340508968 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fe59c700 1 --2- 172.21.15.107:0/2340508968 >> v2:172.21.15.107:3300/0 conn(0x7f68001596a0 0x7f68000b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fed9d700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f680015a190 0x7f68000709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fd59a700 1 -- 172.21.15.107:0/2340508968 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730586834 0 0) 0x7f68000b3590 con 0x7f68000b4e50 2024-05-08T21:00:23.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fd59a700 1 -- 172.21.15.107:0/2340508968 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e80035d0 con 0x7f68000b4e50 2024-05-08T21:00:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fe59c700 1 -- 172.21.15.107:0/2340508968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f680015a190 msgr2=0x7f68000709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fe59c700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f680015a190 0x7f68000709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fe59c700 1 -- 172.21.15.107:0/2340508968 >> v1:172.21.15.107:6789/0 conn(0x7f68000b4e50 legacy=0x7f6800159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fe59c700 1 -- 172.21.15.107:0/2340508968 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000b2ab0 con 0x7f68001596a0 2024-05-08T21:00:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fed9d700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f680015a190 0x7f68000709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:23.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fe59c700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68001596a0 0x7f68000b4910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009850 tx=0x7f67f4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32022e0a1231237c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fd59a700 1 -- 172.21.15.107:0/2340508968 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4011830 con 0x7f68001596a0 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fd59a700 1 -- 172.21.15.107:0/2340508968 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f4011990 con 0x7f68001596a0 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67fd59a700 1 -- 172.21.15.107:0/2340508968 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4011d40 con 0x7f68001596a0 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- 172.21.15.107:0/2340508968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68001596a0 msgr2=0x7f68000b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68001596a0 0x7f68000b4910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009850 tx=0x7f67f4009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- 172.21.15.107:0/2340508968 shutdown_connections 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f680015a190 0x7f68000709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2340508968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68001596a0 0x7f68000b4910 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- 172.21.15.107:0/2340508968 >> 172.21.15.107:0/2340508968 conn(0x7f680006c330 msgr2=0x7f680006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- 172.21.15.107:0/2340508968 shutdown_connections 2024-05-08T21:00:23.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.208+0000 7f67ff59e700 1 -- 172.21.15.107:0/2340508968 wait complete. 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 Processor -- start 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 -- start start 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 0x7f68001f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68001596a0 0x7f6800152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f680015a190 0x7f68000a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000aee00 con 0x7f68000b4e50 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000a8b30 con 0x7f680015a190 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68001f77e0 con 0x7f68001596a0 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 0x7f68001f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 0x7f68001f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37868/0 (socket says 172.21.15.107:37868) 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fdd9b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68001596a0 0x7f6800152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 -- 172.21.15.107:0/2991711320 learned_addr learned my addr 172.21.15.107:0/2991711320 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fed9d700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f680015a190 0x7f68000a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 -- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68001596a0 msgr2=0x7f6800152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68001596a0 0x7f6800152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 -- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f680015a190 msgr2=0x7f68000a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f680015a190 0x7f68000a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 -- 172.21.15.107:0/2991711320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f8009a70 con 0x7f68000b4e50 2024-05-08T21:00:23.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67fe59c700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 0x7f68001f7190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f67f4014040 tx=0x7f67f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40044d0 con 0x7f68000b4e50 2024-05-08T21:00:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f401e070 con 0x7f68000b4e50 2024-05-08T21:00:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f40094b0 con 0x7f68000b4e50 2024-05-08T21:00:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4003900 con 0x7f68000b4e50 2024-05-08T21:00:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.212+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68001f7da0 con 0x7f68000b4e50 2024-05-08T21:00:23.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.216+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68000aef70 con 0x7f68000b4e50 2024-05-08T21:00:23.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.216+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f67f4003a60 con 0x7f68000b4e50 2024-05-08T21:00:23.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.216+0000 7f67eeffd700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f67e0066730 0x7f67e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.216+0000 7f67fdd9b700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f67e0066730 0x7f67e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.216+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f67f4020070 con 0x7f68000b4e50 2024-05-08T21:00:23.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.216+0000 7f67fdd9b700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f67e0066730 0x7f67e0068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68000cb580 tx=0x7f67f0007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.224+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f67f4052860 con 0x7f68000b4e50 2024-05-08T21:00:23.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.396+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68000684b0 con 0x7f68000b4e50 2024-05-08T21:00:23.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67eeffd700 1 -- 172.21.15.107:0/2991711320 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7f67f4006ce0 con 0x7f68000b4e50 2024-05-08T21:00:23.407 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:23.407 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f67e0066730 msgr2=0x7f67e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f67e0066730 0x7f67e0068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68000cb580 tx=0x7f67f0007de0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 msgr2=0x7f68001f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 0x7f68001f7190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f67f4014040 tx=0x7f67f4004770 comp rx=0 tx=0).stop 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 shutdown_connections 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f680015a190 0x7f68000a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f67e0066730 0x7f67e0068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68001596a0 0x7f6800152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 --2- 172.21.15.107:0/2991711320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68000b4e50 0x7f68001f7190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 >> 172.21.15.107:0/2991711320 conn(0x7f680006c330 msgr2=0x7f68000ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 shutdown_connections 2024-05-08T21:00:23.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.400+0000 7f67ff59e700 1 -- 172.21.15.107:0/2991711320 wait complete. 2024-05-08T21:00:23.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:56:28.753271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:56:39.969005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:56:40.759304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T21:00:23.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T21:00:23.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.532+0000 7f9b51796700 1 Processor -- start 2024-05-08T21:00:23.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.532+0000 7f9b51796700 1 -- start start 2024-05-08T21:00:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9b4c15d1d0 0x7f9b4c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 0x7f9b4c06cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c06ca90 con 0x7f9b4c071630 2024-05-08T21:00:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0b3d10 con 0x7f9b4c15d1d0 2024-05-08T21:00:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c071ac0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 0x7f9b4c06cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 0x7f9b4c06cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41644/0 (socket says 172.21.15.107:41644) 2024-05-08T21:00:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 -- 172.21.15.107:0/4139545725 learned_addr learned my addr 172.21.15.107:0/4139545725 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:23.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b4bfff700 1 --2- 172.21.15.107:0/4139545725 >> v2:172.21.15.195:3300/0 conn(0x7f9b4c15d1d0 0x7f9b4c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b4b7fe700 1 -- 172.21.15.107:0/4139545725 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514330902 0 0) 0x7f9b4c06ca90 con 0x7f9b4c071630 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b4b7fe700 1 -- 172.21.15.107:0/4139545725 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b380035d0 con 0x7f9b4c071630 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 -- 172.21.15.107:0/4139545725 >> v2:172.21.15.195:3300/0 conn(0x7f9b4c15d1d0 msgr2=0x7f9b4c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 --2- 172.21.15.107:0/4139545725 >> v2:172.21.15.195:3300/0 conn(0x7f9b4c15d1d0 0x7f9b4c0710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 -- 172.21.15.107:0/4139545725 >> v1:172.21.15.195:6789/0 conn(0x7f9b4c071630 legacy=0x7f9b4c0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 -- 172.21.15.107:0/4139545725 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c15d5b0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b50f95700 1 --2- 172.21.15.107:0/4139545725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 0x7f9b4c06cf70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009e50 tx=0x7f9b4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0236c8b4acc28d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b4b7fe700 1 -- 172.21.15.107:0/4139545725 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400e070 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b4b7fe700 1 -- 172.21.15.107:0/4139545725 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400b910 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b4b7fe700 1 -- 172.21.15.107:0/4139545725 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400bc80 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- 172.21.15.107:0/4139545725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 msgr2=0x7f9b4c06cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 --2- 172.21.15.107:0/4139545725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 0x7f9b4c06cf70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009e50 tx=0x7f9b4400b330 comp rx=0 tx=0).stop 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- 172.21.15.107:0/4139545725 shutdown_connections 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 --2- 172.21.15.107:0/4139545725 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c0b23d0 0x7f9b4c06cf70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 --2- 172.21.15.107:0/4139545725 >> v2:172.21.15.195:3300/0 conn(0x7f9b4c15d1d0 0x7f9b4c0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- 172.21.15.107:0/4139545725 >> 172.21.15.107:0/4139545725 conn(0x7f9b4c06a360 msgr2=0x7f9b4c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- 172.21.15.107:0/4139545725 shutdown_connections 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.536+0000 7f9b51796700 1 -- 172.21.15.107:0/4139545725 wait complete. 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 Processor -- start 2024-05-08T21:00:23.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 -- start start 2024-05-08T21:00:23.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b4c071630 0x7f9b4c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 0x7f9b4c15f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c15d1d0 0x7f9b4c15faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c15e8c0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c15aef0 con 0x7f9b4c071630 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c15dcb0 con 0x7f9b4c15d1d0 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 0x7f9b4c15f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 0x7f9b4c15f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37876/0 (socket says 172.21.15.107:37876) 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 -- 172.21.15.107:0/552496268 learned_addr learned my addr 172.21.15.107:0/552496268 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b50f95700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c15d1d0 0x7f9b4c15faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b4bfff700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b4c071630 0x7f9b4c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 -- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c15d1d0 msgr2=0x7f9b4c15faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c15d1d0 0x7f9b4c15faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 -- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b4c071630 msgr2=0x7f9b4c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b4c071630 0x7f9b4c15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 -- 172.21.15.107:0/552496268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009b30 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b50f95700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c15d1d0 0x7f9b4c15faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b43fff700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 0x7f9b4c15f5b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c490 tx=0x7f9b3400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340052d0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34005450 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c15df90 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340038e0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.540+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c15e550 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.544+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c0684b0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.544+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b34003a40 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.544+0000 7f9b497fa700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9b2c066760 0x7f9b2c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.544+0000 7f9b4bfff700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9b2c066760 0x7f9b2c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.544+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f9b340837a0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.544+0000 7f9b4bfff700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9b2c066760 0x7f9b2c068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009b80 tx=0x7f9b3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.552+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9b340509a0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.716+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b4c156e90 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.716+0000 7f9b497fa700 1 -- 172.21.15.107:0/552496268 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b34053fc0 con 0x7f9b4c0b23d0 2024-05-08T21:00:23.724 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-08T21:00:23.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9b2c066760 msgr2=0x7f9b2c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9b2c066760 0x7f9b2c068c20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009b80 tx=0x7f9b3c008040 comp rx=0 tx=0).stop 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 msgr2=0x7f9b4c15f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 0x7f9b4c15f5b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c490 tx=0x7f9b3400c850 comp rx=0 tx=0).stop 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 shutdown_connections 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9b2c066760 0x7f9b2c068c20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9b4c15d1d0 0x7f9b4c15faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9b4c0b23d0 0x7f9b4c15f5b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 --2- 172.21.15.107:0/552496268 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b4c071630 0x7f9b4c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 >> 172.21.15.107:0/552496268 conn(0x7f9b4c06a360 msgr2=0x7f9b4c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 shutdown_connections 2024-05-08T21:00:23.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.720+0000 7f9b51796700 1 -- 172.21.15.107:0/552496268 wait complete. 2024-05-08T21:00:23.743 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T21:00:23.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 Processor -- start 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 -- start start 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f33cc15ead0 0x7f33cc0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33cc0ce4f0 0x7f33cc06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc06c7d0 con 0x7f33cc15ae10 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0ce9a0 con 0x7f33cc0ce4f0 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cbfff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0acb30 con 0x7f33cc15ead0 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cb7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33cc0ce4f0 0x7f33cc06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cb7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f33cc0ce4f0 0x7f33cc06cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37890/0 (socket says 172.21.15.107:37890) 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33cb7fe700 1 -- 172.21.15.107:0/2271091725 learned_addr learned my addr 172.21.15.107:0/2271091725 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.848+0000 7f33ca7fc700 1 --2- 172.21.15.107:0/2271091725 >> v2:172.21.15.195:3300/0 conn(0x7f33cc15ead0 0x7f33cc0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cb7fe700 1 -- 172.21.15.107:0/2271091725 >> v2:172.21.15.195:3300/0 conn(0x7f33cc15ead0 msgr2=0x7f33cc0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cb7fe700 1 --2- 172.21.15.107:0/2271091725 >> v2:172.21.15.195:3300/0 conn(0x7f33cc15ead0 0x7f33cc0cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cb7fe700 1 -- 172.21.15.107:0/2271091725 >> v1:172.21.15.195:6789/0 conn(0x7f33cc15ae10 legacy=0x7f33cc0ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cb7fe700 1 -- 172.21.15.107:0/2271091725 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc06c4d0 con 0x7f33cc0ce4f0 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cb7fe700 1 --2- 172.21.15.107:0/2271091725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc06cc60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009910 tx=0x7f33c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139bbe5cdd6ef3a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33c9ffb700 1 -- 172.21.15.107:0/2271091725 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4011830 con 0x7f33cc0ce4f0 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33c9ffb700 1 -- 172.21.15.107:0/2271091725 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4011990 con 0x7f33cc0ce4f0 2024-05-08T21:00:23.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33c9ffb700 1 -- 172.21.15.107:0/2271091725 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4011d40 con 0x7f33cc0ce4f0 2024-05-08T21:00:23.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 -- 172.21.15.107:0/2271091725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc0ce4f0 msgr2=0x7f33cc06cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.862 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2271091725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc06cc60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009910 tx=0x7f33c4009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 -- 172.21.15.107:0/2271091725 shutdown_connections 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2271091725 >> v2:172.21.15.195:3300/0 conn(0x7f33cc15ead0 0x7f33cc0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2271091725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc06cc60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 -- 172.21.15.107:0/2271091725 >> 172.21.15.107:0/2271091725 conn(0x7f33cc0b0de0 msgr2=0x7f33cc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 -- 172.21.15.107:0/2271091725 shutdown_connections 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 -- 172.21.15.107:0/2271091725 wait complete. 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 Processor -- start 2024-05-08T21:00:23.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.852+0000 7f33cbfff700 1 -- start start 2024-05-08T21:00:23.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc09a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 0x7f33cc15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc15ead0 0x7f33cc152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc157800 con 0x7f33cc15ead0 2024-05-08T21:00:23.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc09add0 con 0x7f33cc0ce4f0 2024-05-08T21:00:23.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc09b0b0 con 0x7f33cc15ae10 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc15ead0 0x7f33cc152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 0x7f33cc15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33caffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 0x7f33cc15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41660/0 (socket says 172.21.15.107:41660) 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 -- 172.21.15.107:0/2773346841 learned_addr learned my addr 172.21.15.107:0/2773346841 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc15ead0 0x7f33cc152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37906/0 (socket says 172.21.15.107:37906) 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 -- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33cc0ce4f0 msgr2=0x7f33cc09a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc09a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 -- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc15ead0 msgr2=0x7f33cc152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc15ead0 0x7f33cc152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 -- 172.21.15.107:0/2773346841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009570 con 0x7f33cc15ae10 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33ca7fc700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 0x7f33cc15d350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00efc0 tx=0x7f33bc009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00cae0 con 0x7f33cc15ae10 2024-05-08T21:00:23.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc00f040 con 0x7f33cc15ae10 2024-05-08T21:00:23.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc09b390 con 0x7f33cc15ae10 2024-05-08T21:00:23.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00ce60 con 0x7f33cc15ae10 2024-05-08T21:00:23.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.856+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc09a9c0 con 0x7f33cc15ae10 2024-05-08T21:00:23.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.860+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc157970 con 0x7f33cc15ae10 2024-05-08T21:00:23.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.860+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33bc014480 con 0x7f33cc15ae10 2024-05-08T21:00:23.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.860+0000 7f33c3fff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f33ac066730 0x7f33ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:23.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.860+0000 7f33caffd700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f33ac066730 0x7f33ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:23.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.860+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f33bc084c80 con 0x7f33cc15ae10 2024-05-08T21:00:23.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.860+0000 7f33caffd700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f33ac066730 0x7f33ac068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33b40018a0 tx=0x7f33b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:23.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:23.872+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f33bc051f30 con 0x7f33cc15ae10 2024-05-08T21:00:24.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.040+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33cc0684b0 con 0x7f33cc15ae10 2024-05-08T21:00:24.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.040+0000 7f33c3fff700 1 -- 172.21.15.107:0/2773346841 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33bc055550 con 0x7f33cc15ae10 2024-05-08T21:00:24.050 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f33ac066730 msgr2=0x7f33ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f33ac066730 0x7f33ac068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33b40018a0 tx=0x7f33b4009040 comp rx=0 tx=0).stop 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 msgr2=0x7f33cc15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 0x7f33cc15d350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00efc0 tx=0x7f33bc009f80 comp rx=0 tx=0).stop 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 shutdown_connections 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33cc15ead0 0x7f33cc152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f33ac066730 0x7f33ac068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f33cc15ae10 0x7f33cc15d350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 --2- 172.21.15.107:0/2773346841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f33cc0ce4f0 0x7f33cc09a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 >> 172.21.15.107:0/2773346841 conn(0x7f33cc0b0de0 msgr2=0x7f33cc0aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:24.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 shutdown_connections 2024-05-08T21:00:24.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.044+0000 7f33cbfff700 1 -- 172.21.15.107:0/2773346841 wait complete. 2024-05-08T21:00:24.066 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T21:00:24.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 Processor -- start 2024-05-08T21:00:24.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 -- start start 2024-05-08T21:00:24.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 0x7fd3a406b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3a40b37f0 0x7fd3a415de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a415d990 con 0x7fd3a40b40d0 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a4146ec0 con 0x7fd3a40b37f0 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3aa0fa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a406c2f0 con 0x7fd3a4146ae0 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 0x7fd3a406b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 0x7fd3a406b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41664/0 (socket says 172.21.15.107:41664) 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a3fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd3a40b37f0 0x7fd3a415de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a2ffd700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd3a40b40d0 0x7fd3a40b30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:56410/0 (socket says 172.21.15.107:56410) 2024-05-08T21:00:24.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 -- 172.21.15.107:0/663801842 learned_addr learned my addr 172.21.15.107:0/663801842 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:24.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 -- 172.21.15.107:0/663801842 >> v2:172.21.15.195:3300/0 conn(0x7fd3a40b37f0 msgr2=0x7fd3a415de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:24.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 --2- 172.21.15.107:0/663801842 >> v2:172.21.15.195:3300/0 conn(0x7fd3a40b37f0 0x7fd3a415de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 -- 172.21.15.107:0/663801842 >> v1:172.21.15.195:6789/0 conn(0x7fd3a40b40d0 legacy=0x7fd3a40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a37fe700 1 -- 172.21.15.107:0/663801842 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a406c5d0 con 0x7fd3a4146ae0 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.180+0000 7fd3a3fff700 1 --2- 172.21.15.107:0/663801842 >> v2:172.21.15.195:3300/0 conn(0x7fd3a40b37f0 0x7fd3a415de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3a37fe700 1 --2- 172.21.15.107:0/663801842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 0x7fd3a406b980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd394009910 tx=0x7fd394009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698e706ae6b4f473 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3a27fc700 1 -- 172.21.15.107:0/663801842 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011830 con 0x7fd3a4146ae0 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3a27fc700 1 -- 172.21.15.107:0/663801842 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394011990 con 0x7fd3a4146ae0 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3a27fc700 1 -- 172.21.15.107:0/663801842 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011d40 con 0x7fd3a4146ae0 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/663801842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 msgr2=0x7fd3a406b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/663801842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 0x7fd3a406b980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd394009910 tx=0x7fd394009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/663801842 shutdown_connections 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/663801842 >> v2:172.21.15.195:3300/0 conn(0x7fd3a40b37f0 0x7fd3a415de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/663801842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a4146ae0 0x7fd3a406b980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/663801842 >> 172.21.15.107:0/663801842 conn(0x7fd3a4073ab0 msgr2=0x7fd3a4073ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:24.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/663801842 shutdown_connections 2024-05-08T21:00:24.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/663801842 wait complete. 2024-05-08T21:00:24.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 Processor -- start 2024-05-08T21:00:24.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.184+0000 7fd3aa0fa700 1 -- start start 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 0x7fd3a415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a40b40d0 0x7fd3a41f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3a4146ae0 0x7fd3a413d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a413f030 con 0x7fd3a40b37f0 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a415d080 con 0x7fd3a4146ae0 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a413eab0 con 0x7fd3a40b40d0 2024-05-08T21:00:24.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 0x7fd3a415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 0x7fd3a415cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37910/0 (socket says 172.21.15.107:37910) 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 -- 172.21.15.107:0/2023920059 learned_addr learned my addr 172.21.15.107:0/2023920059 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a3fff700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3a4146ae0 0x7fd3a413d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a2ffd700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a40b40d0 0x7fd3a41f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 -- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a40b40d0 msgr2=0x7fd3a41f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a40b40d0 0x7fd3a41f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 -- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3a4146ae0 msgr2=0x7fd3a413d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3a4146ae0 0x7fd3a413d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 -- 172.21.15.107:0/2023920059 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c009a70 con 0x7fd3a40b37f0 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a3fff700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3a4146ae0 0x7fd3a413d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3a37fe700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 0x7fd3a415cb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd3a406c430 tx=0x7fd394004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:24.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394004590 con 0x7fd3a40b37f0 2024-05-08T21:00:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39401e070 con 0x7fd3a40b37f0 2024-05-08T21:00:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd394009570 con 0x7fd3a40b37f0 2024-05-08T21:00:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394003900 con 0x7fd3a40b37f0 2024-05-08T21:00:24.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a413e290 con 0x7fd3a40b37f0 2024-05-08T21:00:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a40684b0 con 0x7fd3a40b37f0 2024-05-08T21:00:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.188+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd394003a60 con 0x7fd3a40b37f0 2024-05-08T21:00:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.192+0000 7fd38bfff700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd390066730 0x7fd390068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.192+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fd394084e50 con 0x7fd3a40b37f0 2024-05-08T21:00:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.192+0000 7fd3a2ffd700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd390066730 0x7fd390068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.192+0000 7fd3a2ffd700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd390066730 0x7fd390068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40b4f70 tx=0x7fd398007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:24.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.196+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd394052220 con 0x7fd3a40b37f0 2024-05-08T21:00:24.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd3a40b5840 con 0x7fd3a40b37f0 2024-05-08T21:00:24.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd38bfff700 1 -- 172.21.15.107:0/2023920059 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd394015020 con 0x7fd3a40b37f0 2024-05-08T21:00:24.368 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-08T21:00:24.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd390066730 msgr2=0x7fd390068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd390066730 0x7fd390068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40b4f70 tx=0x7fd398007d30 comp rx=0 tx=0).stop 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 msgr2=0x7fd3a415cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 0x7fd3a415cb40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd3a406c430 tx=0x7fd394004770 comp rx=0 tx=0).stop 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 shutdown_connections 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd3a4146ae0 0x7fd3a413d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd390066730 0x7fd390068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd3a40b40d0 0x7fd3a41f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 --2- 172.21.15.107:0/2023920059 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd3a40b37f0 0x7fd3a415cb40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 >> 172.21.15.107:0/2023920059 conn(0x7fd3a4073ab0 msgr2=0x7fd3a40b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 shutdown_connections 2024-05-08T21:00:24.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.360+0000 7fd3aa0fa700 1 -- 172.21.15.107:0/2023920059 wait complete. 2024-05-08T21:00:24.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T21:00:24.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.492+0000 7fb0b9944700 1 Processor -- start 2024-05-08T21:00:24.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.492+0000 7fb0b9944700 1 -- start start 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.492+0000 7fb0b9944700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fb0b4140130 0x7fb0b40b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.492+0000 7fb0b9944700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb0b415e430 0x7fb0b40b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.492+0000 7fb0b9944700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b4142880 0x7fb0b4142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b4143250 con 0x7fb0b415e430 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40b4800 con 0x7fb0b4140130 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4140510 con 0x7fb0b4142880 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb0b415e430 0x7fb0b40b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb0b415e430 0x7fb0b40b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37924/0 (socket says 172.21.15.107:37924) 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 -- 172.21.15.107:0/3933593806 learned_addr learned my addr 172.21.15.107:0/3933593806 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:24.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9143700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b4142880 0x7fb0b4142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b8942700 1 --2- 172.21.15.107:0/3933593806 >> v2:172.21.15.195:3300/0 conn(0x7fb0b4140130 0x7fb0b40b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 -- 172.21.15.107:0/3933593806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b4142880 msgr2=0x7fb0b4142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b4142880 0x7fb0b4142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 -- 172.21.15.107:0/3933593806 >> v2:172.21.15.195:3300/0 conn(0x7fb0b4140130 msgr2=0x7fb0b40b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 --2- 172.21.15.107:0/3933593806 >> v2:172.21.15.195:3300/0 conn(0x7fb0b4140130 0x7fb0b40b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 -- 172.21.15.107:0/3933593806 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40b24a0 con 0x7fb0b415e430 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9143700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b4142880 0x7fb0b4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b3fff700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b415e430 0x7fb0b40b1f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb0b404f790 tx=0x7fb0a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693a0db69fce0e6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b37fe700 1 -- 172.21.15.107:0/3933593806 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800b8a0 con 0x7fb0b415e430 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b37fe700 1 -- 172.21.15.107:0/3933593806 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800ba00 con 0x7fb0b415e430 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b37fe700 1 -- 172.21.15.107:0/3933593806 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800bd90 con 0x7fb0b415e430 2024-05-08T21:00:24.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- 172.21.15.107:0/3933593806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b415e430 msgr2=0x7fb0b40b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b415e430 0x7fb0b40b1f60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb0b404f790 tx=0x7fb0a8009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- 172.21.15.107:0/3933593806 shutdown_connections 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b4142880 0x7fb0b4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 --2- 172.21.15.107:0/3933593806 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b415e430 0x7fb0b40b1f60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 --2- 172.21.15.107:0/3933593806 >> v2:172.21.15.195:3300/0 conn(0x7fb0b4140130 0x7fb0b40b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- 172.21.15.107:0/3933593806 >> 172.21.15.107:0/3933593806 conn(0x7fb0b406c330 msgr2=0x7fb0b406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- 172.21.15.107:0/3933593806 shutdown_connections 2024-05-08T21:00:24.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.496+0000 7fb0b9944700 1 -- 172.21.15.107:0/3933593806 wait complete. 2024-05-08T21:00:24.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 Processor -- start 2024-05-08T21:00:24.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 -- start start 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b4140130 0x7fb0b41414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0b4142880 0x7fb0b413e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b415e430 0x7fb0b40afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41419f0 con 0x7fb0b4140130 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b413ecd0 con 0x7fb0b4142880 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9944700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41406f0 con 0x7fb0b415e430 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b8942700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b4140130 0x7fb0b41414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0b4142880 0x7fb0b413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0b4142880 0x7fb0b413e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55694/0 (socket says 172.21.15.107:55694) 2024-05-08T21:00:24.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b3fff700 1 -- 172.21.15.107:0/4080650705 learned_addr learned my addr 172.21.15.107:0/4080650705 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b9143700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b415e430 0x7fb0b40afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b8942700 1 -- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b415e430 msgr2=0x7fb0b40afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b8942700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b415e430 0x7fb0b40afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b8942700 1 -- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0b4142880 msgr2=0x7fb0b413e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b8942700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0b4142880 0x7fb0b413e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.500+0000 7fb0b8942700 1 -- 172.21.15.107:0/4080650705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8009570 con 0x7fb0b4140130 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b8942700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b4140130 0x7fb0b41414b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400d5f0 tx=0x7fb0a400d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40125f0 con 0x7fb0b4140130 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a4012750 con 0x7fb0b4140130 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b41409d0 con 0x7fb0b4140130 2024-05-08T21:00:24.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4012b00 con 0x7fb0b4140130 2024-05-08T21:00:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b4140f90 con 0x7fb0b4140130 2024-05-08T21:00:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b40684b0 con 0x7fb0b4140130 2024-05-08T21:00:24.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0a4012c60 con 0x7fb0b4140130 2024-05-08T21:00:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.504+0000 7fb0b17fa700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb0a0066730 0x7fb0a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.508+0000 7fb0b3fff700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb0a0066730 0x7fb0a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.508+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fb0a40843a0 con 0x7fb0b4140130 2024-05-08T21:00:24.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.508+0000 7fb0b3fff700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb0a0066730 0x7fb0a0068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0b41f6680 tx=0x7fb0a8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:24.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.516+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fb0a40516d0 con 0x7fb0b4140130 2024-05-08T21:00:24.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0b406dfe0 con 0x7fb0b4140130 2024-05-08T21:00:24.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b17fa700 1 -- 172.21.15.107:0/4080650705 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb0a4054cf0 con 0x7fb0b4140130 2024-05-08T21:00:24.702 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb0a0066730 msgr2=0x7fb0a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb0a0066730 0x7fb0a0068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0b41f6680 tx=0x7fb0a8008030 comp rx=0 tx=0).stop 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b4140130 msgr2=0x7fb0b41414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b4140130 0x7fb0b41414b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400d5f0 tx=0x7fb0a400d900 comp rx=0 tx=0).stop 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 shutdown_connections 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fb0a0066730 0x7fb0a0068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb0b415e430 0x7fb0b40afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0b4142880 0x7fb0b413e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 --2- 172.21.15.107:0/4080650705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b4140130 0x7fb0b41414b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:24.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 >> 172.21.15.107:0/4080650705 conn(0x7fb0b406c330 msgr2=0x7fb0b415f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:24.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 shutdown_connections 2024-05-08T21:00:24.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:24.692+0000 7fb0b9944700 1 -- 172.21.15.107:0/4080650705 wait complete. 2024-05-08T21:00:24.704 INFO:teuthology.orchestra.run.smithi107.stderr:listed 0 entries 2024-05-08T21:00:24.714 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi195.front.sepia.ceph.com... 2024-05-08T21:00:24.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:24.715 DEBUG:teuthology.orchestra.run.smithi195:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-08T21:00:24.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi195.stderr:ceph-fuse[31815]: fuse finished with error 0 and tester_r 0 2024-05-08T21:00:24.729 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:00:24.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:00:24.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:24.829 DEBUG:teuthology.orchestra.run.smithi195:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-08T21:00:24.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:24.837 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-08T21:00:24.845 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-08T21:00:24.845 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T21:00:24.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:24.845 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-08T21:00:24.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:24.858 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T21:00:24.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:24.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-08T21:00:25.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:25.093 DEBUG:teuthology.orchestra.run.smithi195:> ip netns list 2024-05-08T21:00:25.101 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-08T21:00:25.101 INFO:teuthology.orchestra.run.smithi195.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-08T21:00:25.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:25.102 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-08T21:00:25.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:25.159 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-08T21:00:25.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T21:00:25.170 DEBUG:teuthology.orchestra.run.smithi195:> sudo ip link delete ceph-brx 2024-05-08T21:00:25.321 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T21:00:25.332 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T21:00:25.332 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:00:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.444+0000 7f6fb88ad700 1 Processor -- start 2024-05-08T21:00:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.444+0000 7f6fb88ad700 1 -- start start 2024-05-08T21:00:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f6fb406b370 0x7f6fb415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40ad980 con 0x7f6fb40b35c0 2024-05-08T21:00:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb415e6e0 con 0x7f6fb40ade10 2024-05-08T21:00:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb4071ce0 con 0x7f6fb406b370 2024-05-08T21:00:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6fb40b35c0 0x7f6fb406b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56280/0 (socket says 172.21.15.107:56280) 2024-05-08T21:00:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 -- 172.21.15.107:0/651502322 learned_addr learned my addr 172.21.15.107:0/651502322 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:25.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb2d9d700 1 --2- 172.21.15.107:0/651502322 >> v2:172.21.15.195:3300/0 conn(0x7f6fb406b370 0x7f6fb415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320562174 0 0) 0x7f6fb40ad980 con 0x7f6fb40b35c0 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa00035d0 con 0x7f6fb40b35c0 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952934236 0 0) 0x7f6fa00035d0 con 0x7f6fb40b35c0 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 >> v2:172.21.15.195:3300/0 conn(0x7f6fb406b370 msgr2=0x7f6fb415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 --2- 172.21.15.107:0/651502322 >> v2:172.21.15.195:3300/0 conn(0x7f6fb406b370 0x7f6fb415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 >> v1:172.21.15.195:6789/0 conn(0x7f6fb40ade10 legacy=0x7f6fb40ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40b3b30 con 0x7f6fb40b35c0 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7f6f9c001670 con 0x7f6fb40b35c0 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 >> v1:172.21.15.107:6789/0 conn(0x7f6fb40b35c0 legacy=0x7f6fb406b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0003a20 0x7f6fa0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0004870 0x7f6fa0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa0005230 0x7f6fa000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa000c0a0 con 0x7f6fa0004870 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa000c210 con 0x7f6fa0005230 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa000c3d0 con 0x7f6fa0003a20 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0004870 0x7f6fa0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb2d9d700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0003a20 0x7f6fa0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb359e700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa0005230 0x7f6fa000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 -- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0003a20 msgr2=0x7f6fa0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0003a20 0x7f6fa0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 -- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa0005230 msgr2=0x7f6fa000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fa0005230 0x7f6fa000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb359e700 1 -- 172.21.15.107:0/651502322 reap_dead start 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 -- 172.21.15.107:0/651502322 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00035d0 con 0x7f6fa0004870 2024-05-08T21:00:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fabfff700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0004870 0x7f6fa0004cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00c210 tx=0x7f6fa00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250b9265a142eb23 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00cdb0 con 0x7f6fa0004870 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c007ba0 con 0x7f6fa0004870 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb259c700 1 -- 172.21.15.107:0/651502322 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c005bc0 con 0x7f6fa0004870 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- 172.21.15.107:0/651502322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0004870 msgr2=0x7f6fa0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0004870 0x7f6fa0004cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00c210 tx=0x7f6fa00058a0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- 172.21.15.107:0/651502322 shutdown_connections 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/651502322 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fa0004870 0x7f6fa0004cf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- 172.21.15.107:0/651502322 >> 172.21.15.107:0/651502322 conn(0x7f6fb4070960 msgr2=0x7f6fb4070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.448+0000 7f6fb88ad700 1 -- 172.21.15.107:0/651502322 shutdown_connections 2024-05-08T21:00:25.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 -- 172.21.15.107:0/651502322 wait complete. 2024-05-08T21:00:25.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 Processor -- start 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 -- start start 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0004870 0x7f6fb414d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fb40cc460 0x7f6fb4151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 0x7f6fb4151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb41538f0 con 0x7f6fb40cbe10 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb414d780 con 0x7f6fb40cc460 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb88ad700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40cd550 con 0x7f6fa0004870 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 0x7f6fb4151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 0x7f6fb4151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37944/0 (socket says 172.21.15.107:37944) 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 -- 172.21.15.107:0/2512592299 learned_addr learned my addr 172.21.15.107:0/2512592299 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb2d9d700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0004870 0x7f6fb414d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fabfff700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fb40cc460 0x7f6fb4151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 -- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0004870 msgr2=0x7f6fb414d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0004870 0x7f6fb414d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 -- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fb40cc460 msgr2=0x7f6fb4151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fb40cc460 0x7f6fb4151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.452+0000 7f6fb359e700 1 -- 172.21.15.107:0/2512592299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40cc9d0 con 0x7f6fb40cbe10 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fb359e700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 0x7f6fb4151b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4070720 tx=0x7f6fac00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac003a20 con 0x7f6fb40cbe10 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac003ba0 con 0x7f6fb40cbe10 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb40cccb0 con 0x7f6fb40cbe10 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0050d0 con 0x7f6fb40cbe10 2024-05-08T21:00:25.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40cd270 con 0x7f6fb40cbe10 2024-05-08T21:00:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4153a60 con 0x7f6fb40cbe10 2024-05-08T21:00:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.456+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fac005230 con 0x7f6fb40cbe10 2024-05-08T21:00:25.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.460+0000 7f6fab7fe700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6f94066760 0x7f6f94068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.460+0000 7f6fb2d9d700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6f94066760 0x7f6f94068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.460+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f6fac084000 con 0x7f6fb40cbe10 2024-05-08T21:00:25.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.460+0000 7f6fb2d9d700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6f94066760 0x7f6f94068c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009bf0 tx=0x7f6fa4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:25.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.468+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f6fac0512a0 con 0x7f6fb40cbe10 2024-05-08T21:00:25.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.640+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fb40684b0 con 0x7f6f94066760 2024-05-08T21:00:25.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.648+0000 7f6fab7fe700 1 -- 172.21.15.107:0/2512592299 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287806 (secure 0 0 0) 0x7f6fb40684b0 con 0x7f6f94066760 2024-05-08T21:00:25.663 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:25.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6f94066760 msgr2=0x7f6f94068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6f94066760 0x7f6f94068c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4009bf0 tx=0x7f6fa4008040 comp rx=0 tx=0).stop 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 msgr2=0x7f6fb4151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 0x7f6fb4151b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4070720 tx=0x7f6fac00ed50 comp rx=0 tx=0).stop 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 shutdown_connections 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6fb40cbe10 0x7f6fb4151b80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fb40cc460 0x7f6fb4151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6f94066760 0x7f6f94068c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 --2- 172.21.15.107:0/2512592299 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6fa0004870 0x7f6fb414d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 >> 172.21.15.107:0/2512592299 conn(0x7f6fb4070960 msgr2=0x7f6fb40b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:25.667 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 shutdown_connections 2024-05-08T21:00:25.668 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.656+0000 7f6fb88ad700 1 -- 172.21.15.107:0/2512592299 wait complete. 2024-05-08T21:00:25.668 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:00:25.677 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-05-08T21:00:24.774332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681101,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3272,"num_write_kb":33977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7244,"ondisk_log_size":7244,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003791"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442882+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T21:00:02.442882+0000","last_peered":"2024-05-08T21:00:02.442882+0000","last_clean":"2024-05-08T21:00:02.442882+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:00:02.442882+0000","last_undegraded":"2024-05-08T21:00:02.442882+0000","last_fullsized":"2024-05-08T21:00:02.442882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438700+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T21:00:02.438700+0000","last_peered":"2024-05-08T21:00:02.438700+0000","last_clean":"2024-05-08T21:00:02.438700+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:02.438700+0000","last_undegraded":"2024-05-08T21:00:02.438700+0000","last_fullsized":"2024-05-08T21:00:02.438700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437945+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T21:00:02.437945+0000","last_peered":"2024-05-08T21:00:02.437945+0000","last_clean":"2024-05-08T21:00:02.437945+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:00:02.437945+0000","last_undegraded":"2024-05-08T21:00:02.437945+0000","last_fullsized":"2024-05-08T21:00:02.437945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441808+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T21:00:02.441808+0000","last_peered":"2024-05-08T21:00:02.441808+0000","last_clean":"2024-05-08T21:00:02.441808+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:00:02.441808+0000","last_undegraded":"2024-05-08T21:00:02.441808+0000","last_fullsized":"2024-05-08T21:00:02.441808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443042+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T21:00:02.443042+0000","last_peered":"2024-05-08T21:00:02.443042+0000","last_clean":"2024-05-08T21:00:02.443042+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:00:02.443042+0000","last_undegraded":"2024-05-08T21:00:02.443042+0000","last_fullsized":"2024-05-08T21:00:02.443042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447313+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T21:00:02.447313+0000","last_peered":"2024-05-08T21:00:02.447313+0000","last_clean":"2024-05-08T21:00:02.447313+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:00:02.447313+0000","last_undegraded":"2024-05-08T21:00:02.447313+0000","last_fullsized":"2024-05-08T21:00:02.447313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440323+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T21:00:02.440323+0000","last_peered":"2024-05-08T21:00:02.440323+0000","last_clean":"2024-05-08T21:00:02.440323+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:00:02.440323+0000","last_undegraded":"2024-05-08T21:00:02.440323+0000","last_fullsized":"2024-05-08T21:00:02.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443423+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T21:00:02.443423+0000","last_peered":"2024-05-08T21:00:02.443423+0000","last_clean":"2024-05-08T21:00:02.443423+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:00:02.443423+0000","last_undegraded":"2024-05-08T21:00:02.443423+0000","last_fullsized":"2024-05-08T21:00:02.443423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446673+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T21:00:02.446673+0000","last_peered":"2024-05-08T21:00:02.446673+0000","last_clean":"2024-05-08T21:00:02.446673+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:00:02.446673+0000","last_undegraded":"2024-05-08T21:00:02.446673+0000","last_fullsized":"2024-05-08T21:00:02.446673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441716+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T21:00:02.441716+0000","last_peered":"2024-05-08T21:00:02.441716+0000","last_clean":"2024-05-08T21:00:02.441716+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:00:02.441716+0000","last_undegraded":"2024-05-08T21:00:02.441716+0000","last_fullsized":"2024-05-08T21:00:02.441716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441777+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T21:00:02.441777+0000","last_peered":"2024-05-08T21:00:02.441777+0000","last_clean":"2024-05-08T21:00:02.441777+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:02.441777+0000","last_undegraded":"2024-05-08T21:00:02.441777+0000","last_fullsized":"2024-05-08T21:00:02.441777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424189+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T21:00:02.424189+0000","last_peered":"2024-05-08T21:00:02.424189+0000","last_clean":"2024-05-08T21:00:02.424189+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:02.424189+0000","last_undegraded":"2024-05-08T21:00:02.424189+0000","last_fullsized":"2024-05-08T21:00:02.424189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440539+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T21:00:02.440539+0000","last_peered":"2024-05-08T21:00:02.440539+0000","last_clean":"2024-05-08T21:00:02.440539+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:02.440539+0000","last_undegraded":"2024-05-08T21:00:02.440539+0000","last_fullsized":"2024-05-08T21:00:02.440539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437433+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T21:00:02.437433+0000","last_peered":"2024-05-08T21:00:02.437433+0000","last_clean":"2024-05-08T21:00:02.437433+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:02.437433+0000","last_undegraded":"2024-05-08T21:00:02.437433+0000","last_fullsized":"2024-05-08T21:00:02.437433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.423919+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T21:00:02.423919+0000","last_peered":"2024-05-08T21:00:02.423919+0000","last_clean":"2024-05-08T21:00:02.423919+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:02.423919+0000","last_undegraded":"2024-05-08T21:00:02.423919+0000","last_fullsized":"2024-05-08T21:00:02.423919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.434610+0000","last_change":"2024-05-08T20:57:23.947280+0000","last_active":"2024-05-08T21:00:02.434610+0000","last_peered":"2024-05-08T21:00:02.434610+0000","last_clean":"2024-05-08T21:00:02.434610+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:02.434610+0000","last_undegraded":"2024-05-08T21:00:02.434610+0000","last_fullsized":"2024-05-08T21:00:02.434610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:51.369610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446463+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T21:00:02.446463+0000","last_peered":"2024-05-08T21:00:02.446463+0000","last_clean":"2024-05-08T21:00:02.446463+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:02.446463+0000","last_undegraded":"2024-05-08T21:00:02.446463+0000","last_fullsized":"2024-05-08T21:00:02.446463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.435282+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T21:00:02.435282+0000","last_peered":"2024-05-08T21:00:02.435282+0000","last_clean":"2024-05-08T21:00:02.435282+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:02.435282+0000","last_undegraded":"2024-05-08T21:00:02.435282+0000","last_fullsized":"2024-05-08T21:00:02.435282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429755+0000","last_change":"2024-05-08T20:57:23.938502+0000","last_active":"2024-05-08T21:00:02.429755+0000","last_peered":"2024-05-08T21:00:02.429755+0000","last_clean":"2024-05-08T21:00:02.429755+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:00:02.429755+0000","last_undegraded":"2024-05-08T21:00:02.429755+0000","last_fullsized":"2024-05-08T21:00:02.429755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:32.499464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433101+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T21:00:02.433101+0000","last_peered":"2024-05-08T21:00:02.433101+0000","last_clean":"2024-05-08T21:00:02.433101+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.433101+0000","last_undegraded":"2024-05-08T21:00:02.433101+0000","last_fullsized":"2024-05-08T21:00:02.433101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443357+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T21:00:02.443357+0000","last_peered":"2024-05-08T21:00:02.443357+0000","last_clean":"2024-05-08T21:00:02.443357+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:00:02.443357+0000","last_undegraded":"2024-05-08T21:00:02.443357+0000","last_fullsized":"2024-05-08T21:00:02.443357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447239+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T21:00:02.447239+0000","last_peered":"2024-05-08T21:00:02.447239+0000","last_clean":"2024-05-08T21:00:02.447239+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:00:02.447239+0000","last_undegraded":"2024-05-08T21:00:02.447239+0000","last_fullsized":"2024-05-08T21:00:02.447239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424005+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T21:00:02.424005+0000","last_peered":"2024-05-08T21:00:02.424005+0000","last_clean":"2024-05-08T21:00:02.424005+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:02.424005+0000","last_undegraded":"2024-05-08T21:00:02.424005+0000","last_fullsized":"2024-05-08T21:00:02.424005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438896+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T21:00:02.438896+0000","last_peered":"2024-05-08T21:00:02.438896+0000","last_clean":"2024-05-08T21:00:02.438896+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:02.438896+0000","last_undegraded":"2024-05-08T21:00:02.438896+0000","last_fullsized":"2024-05-08T21:00:02.438896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.422268+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T21:00:02.422268+0000","last_peered":"2024-05-08T21:00:02.422268+0000","last_clean":"2024-05-08T21:00:02.422268+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:02.422268+0000","last_undegraded":"2024-05-08T21:00:02.422268+0000","last_fullsized":"2024-05-08T21:00:02.422268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444304+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T21:00:02.444304+0000","last_peered":"2024-05-08T21:00:02.444304+0000","last_clean":"2024-05-08T21:00:02.444304+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:00:02.444304+0000","last_undegraded":"2024-05-08T21:00:02.444304+0000","last_fullsized":"2024-05-08T21:00:02.444304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431032+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T21:00:02.431032+0000","last_peered":"2024-05-08T21:00:02.431032+0000","last_clean":"2024-05-08T21:00:02.431032+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:02.431032+0000","last_undegraded":"2024-05-08T21:00:02.431032+0000","last_fullsized":"2024-05-08T21:00:02.431032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.427540+0000","last_change":"2024-05-08T20:57:23.945199+0000","last_active":"2024-05-08T21:00:02.427540+0000","last_peered":"2024-05-08T21:00:02.427540+0000","last_clean":"2024-05-08T21:00:02.427540+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:00:02.427540+0000","last_undegraded":"2024-05-08T21:00:02.427540+0000","last_fullsized":"2024-05-08T21:00:02.427540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:26.504526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439043+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T21:00:02.439043+0000","last_peered":"2024-05-08T21:00:02.439043+0000","last_clean":"2024-05-08T21:00:02.439043+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:00:02.439043+0000","last_undegraded":"2024-05-08T21:00:02.439043+0000","last_fullsized":"2024-05-08T21:00:02.439043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445362+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T21:00:02.445362+0000","last_peered":"2024-05-08T21:00:02.445362+0000","last_clean":"2024-05-08T21:00:02.445362+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:00:02.445362+0000","last_undegraded":"2024-05-08T21:00:02.445362+0000","last_fullsized":"2024-05-08T21:00:02.445362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444671+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T21:00:02.444671+0000","last_peered":"2024-05-08T21:00:02.444671+0000","last_clean":"2024-05-08T21:00:02.444671+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:02.444671+0000","last_undegraded":"2024-05-08T21:00:02.444671+0000","last_fullsized":"2024-05-08T21:00:02.444671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":82,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442467+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T21:00:02.442467+0000","last_peered":"2024-05-08T21:00:02.442467+0000","last_clean":"2024-05-08T21:00:02.442467+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:02.442467+0000","last_undegraded":"2024-05-08T21:00:02.442467+0000","last_fullsized":"2024-05-08T21:00:02.442467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428747+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T21:00:02.428747+0000","last_peered":"2024-05-08T21:00:02.428747+0000","last_clean":"2024-05-08T21:00:02.428747+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:02.428747+0000","last_undegraded":"2024-05-08T21:00:02.428747+0000","last_fullsized":"2024-05-08T21:00:02.428747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1517","reported_seq":1531,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202034+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:59:50.202034+0000","last_peered":"2024-05-08T20:59:50.202034+0000","last_clean":"2024-05-08T20:59:50.202034+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:59:50.202034+0000","last_undegraded":"2024-05-08T20:59:50.202034+0000","last_fullsized":"2024-05-08T20:59:50.202034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439140+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T21:00:02.439140+0000","last_peered":"2024-05-08T21:00:02.439140+0000","last_clean":"2024-05-08T21:00:02.439140+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:02.439140+0000","last_undegraded":"2024-05-08T21:00:02.439140+0000","last_fullsized":"2024-05-08T21:00:02.439140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188425+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:59:50.188425+0000","last_peered":"2024-05-08T20:59:50.188425+0000","last_clean":"2024-05-08T20:59:50.188425+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:59:50.188425+0000","last_undegraded":"2024-05-08T20:59:50.188425+0000","last_fullsized":"2024-05-08T20:59:50.188425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.191949+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:59:50.191949+0000","last_peered":"2024-05-08T20:59:50.191949+0000","last_clean":"2024-05-08T20:59:50.191949+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:59:50.191949+0000","last_undegraded":"2024-05-08T20:59:50.191949+0000","last_fullsized":"2024-05-08T20:59:50.191949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437829+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T21:00:02.437829+0000","last_peered":"2024-05-08T21:00:02.437829+0000","last_clean":"2024-05-08T21:00:02.437829+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:00:02.437829+0000","last_undegraded":"2024-05-08T21:00:02.437829+0000","last_fullsized":"2024-05-08T21:00:02.437829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:59:50.201560+0000","last_peered":"2024-05-08T20:59:50.201560+0000","last_clean":"2024-05-08T20:59:50.201560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:59:50.201560+0000","last_undegraded":"2024-05-08T20:59:50.201560+0000","last_fullsized":"2024-05-08T20:59:50.201560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431503+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T21:00:02.431503+0000","last_peered":"2024-05-08T21:00:02.431503+0000","last_clean":"2024-05-08T21:00:02.431503+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:02.431503+0000","last_undegraded":"2024-05-08T21:00:02.431503+0000","last_fullsized":"2024-05-08T21:00:02.431503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188688+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:59:50.188688+0000","last_peered":"2024-05-08T20:59:50.188688+0000","last_clean":"2024-05-08T20:59:50.188688+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:59:50.188688+0000","last_undegraded":"2024-05-08T20:59:50.188688+0000","last_fullsized":"2024-05-08T20:59:50.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":86,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446668+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T21:00:02.446668+0000","last_peered":"2024-05-08T21:00:02.446668+0000","last_clean":"2024-05-08T21:00:02.446668+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:02.446668+0000","last_undegraded":"2024-05-08T21:00:02.446668+0000","last_fullsized":"2024-05-08T21:00:02.446668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201606+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:59:50.201606+0000","last_peered":"2024-05-08T20:59:50.201606+0000","last_clean":"2024-05-08T20:59:50.201606+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:59:50.201606+0000","last_undegraded":"2024-05-08T20:59:50.201606+0000","last_fullsized":"2024-05-08T20:59:50.201606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445301+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T21:00:02.445301+0000","last_peered":"2024-05-08T21:00:02.445301+0000","last_clean":"2024-05-08T21:00:02.445301+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:02.445301+0000","last_undegraded":"2024-05-08T21:00:02.445301+0000","last_fullsized":"2024-05-08T21:00:02.445301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.271646+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T21:00:00.271646+0000","last_peered":"2024-05-08T21:00:00.271646+0000","last_clean":"2024-05-08T21:00:00.271646+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:00.271646+0000","last_undegraded":"2024-05-08T21:00:00.271646+0000","last_fullsized":"2024-05-08T21:00:00.271646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444429+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T21:00:02.444429+0000","last_peered":"2024-05-08T21:00:02.444429+0000","last_clean":"2024-05-08T21:00:02.444429+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:02.444429+0000","last_undegraded":"2024-05-08T21:00:02.444429+0000","last_fullsized":"2024-05-08T21:00:02.444429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'912","reported_seq":926,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:55.140352+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:59:55.140352+0000","last_peered":"2024-05-08T20:59:55.140352+0000","last_clean":"2024-05-08T20:59:55.140352+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:59:55.140352+0000","last_undegraded":"2024-05-08T20:59:55.140352+0000","last_fullsized":"2024-05-08T20:59:55.140352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442866+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442866+0000","last_peered":"2024-05-08T21:00:02.442866+0000","last_clean":"2024-05-08T21:00:02.442866+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442866+0000","last_undegraded":"2024-05-08T21:00:02.442866+0000","last_fullsized":"2024-05-08T21:00:02.442866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'17","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192139+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:59:50.192139+0000","last_peered":"2024-05-08T20:59:50.192139+0000","last_clean":"2024-05-08T20:59:50.192139+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:59:50.192139+0000","last_undegraded":"2024-05-08T20:59:50.192139+0000","last_fullsized":"2024-05-08T20:59:50.192139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443140+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T21:00:02.443140+0000","last_peered":"2024-05-08T21:00:02.443140+0000","last_clean":"2024-05-08T21:00:02.443140+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:02.443140+0000","last_undegraded":"2024-05-08T21:00:02.443140+0000","last_fullsized":"2024-05-08T21:00:02.443140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:54.089782+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:59:54.089782+0000","last_peered":"2024-05-08T20:59:54.089782+0000","last_clean":"2024-05-08T20:59:54.089782+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:59:54.089782+0000","last_undegraded":"2024-05-08T20:59:54.089782+0000","last_fullsized":"2024-05-08T20:59:54.089782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444142+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T21:00:02.444142+0000","last_peered":"2024-05-08T21:00:02.444142+0000","last_clean":"2024-05-08T21:00:02.444142+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:00:02.444142+0000","last_undegraded":"2024-05-08T21:00:02.444142+0000","last_fullsized":"2024-05-08T21:00:02.444142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.112953+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:59:56.112953+0000","last_peered":"2024-05-08T20:59:56.112953+0000","last_clean":"2024-05-08T20:59:56.112953+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:59:56.112953+0000","last_undegraded":"2024-05-08T20:59:56.112953+0000","last_fullsized":"2024-05-08T20:59:56.112953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437682+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T21:00:02.437682+0000","last_peered":"2024-05-08T21:00:02.437682+0000","last_clean":"2024-05-08T21:00:02.437682+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:02.437682+0000","last_undegraded":"2024-05-08T21:00:02.437682+0000","last_fullsized":"2024-05-08T21:00:02.437682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.146830+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:59:56.146830+0000","last_peered":"2024-05-08T20:59:56.146830+0000","last_clean":"2024-05-08T20:59:56.146830+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:59:56.146830+0000","last_undegraded":"2024-05-08T20:59:56.146830+0000","last_fullsized":"2024-05-08T20:59:56.146830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442900+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T21:00:02.442900+0000","last_peered":"2024-05-08T21:00:02.442900+0000","last_clean":"2024-05-08T21:00:02.442900+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.442900+0000","last_undegraded":"2024-05-08T21:00:02.442900+0000","last_fullsized":"2024-05-08T21:00:02.442900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194192+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:59:50.194192+0000","last_peered":"2024-05-08T20:59:50.194192+0000","last_clean":"2024-05-08T20:59:50.194192+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:59:50.194192+0000","last_undegraded":"2024-05-08T20:59:50.194192+0000","last_fullsized":"2024-05-08T20:59:50.194192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442829+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T21:00:02.442829+0000","last_peered":"2024-05-08T21:00:02.442829+0000","last_clean":"2024-05-08T21:00:02.442829+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:02.442829+0000","last_undegraded":"2024-05-08T21:00:02.442829+0000","last_fullsized":"2024-05-08T21:00:02.442829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202258+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:59:50.202258+0000","last_peered":"2024-05-08T20:59:50.202258+0000","last_clean":"2024-05-08T20:59:50.202258+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:59:50.202258+0000","last_undegraded":"2024-05-08T20:59:50.202258+0000","last_fullsized":"2024-05-08T20:59:50.202258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443122+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T21:00:02.443122+0000","last_peered":"2024-05-08T21:00:02.443122+0000","last_clean":"2024-05-08T21:00:02.443122+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:00:02.443122+0000","last_undegraded":"2024-05-08T21:00:02.443122+0000","last_fullsized":"2024-05-08T21:00:02.443122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.199275+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:59:50.199275+0000","last_peered":"2024-05-08T20:59:50.199275+0000","last_clean":"2024-05-08T20:59:50.199275+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:59:50.199275+0000","last_undegraded":"2024-05-08T20:59:50.199275+0000","last_fullsized":"2024-05-08T20:59:50.199275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441899+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T21:00:02.441899+0000","last_peered":"2024-05-08T21:00:02.441899+0000","last_clean":"2024-05-08T21:00:02.441899+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:02.441899+0000","last_undegraded":"2024-05-08T21:00:02.441899+0000","last_fullsized":"2024-05-08T21:00:02.441899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196209+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:59:50.196209+0000","last_peered":"2024-05-08T20:59:50.196209+0000","last_clean":"2024-05-08T20:59:50.196209+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:59:50.196209+0000","last_undegraded":"2024-05-08T20:59:50.196209+0000","last_fullsized":"2024-05-08T20:59:50.196209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442928+0000","last_change":"2024-05-08T20:57:23.939637+0000","last_active":"2024-05-08T21:00:02.442928+0000","last_peered":"2024-05-08T21:00:02.442928+0000","last_clean":"2024-05-08T21:00:02.442928+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:00:02.442928+0000","last_undegraded":"2024-05-08T21:00:02.442928+0000","last_fullsized":"2024-05-08T21:00:02.442928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:34.651453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:57:23.936478+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:57:23.936478+0000","last_peered":"2024-05-08T20:57:23.936478+0000","last_clean":"2024-05-08T20:57:23.936478+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:57:23.936478+0000","last_undegraded":"2024-05-08T20:57:23.936478+0000","last_fullsized":"2024-05-08T20:57:23.936478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196651+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:59:50.196651+0000","last_peered":"2024-05-08T20:59:50.196651+0000","last_clean":"2024-05-08T20:59:50.196651+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:59:50.196651+0000","last_undegraded":"2024-05-08T20:59:50.196651+0000","last_fullsized":"2024-05-08T20:59:50.196651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445409+0000","last_change":"2024-05-08T20:57:23.937184+0000","last_active":"2024-05-08T21:00:02.445409+0000","last_peered":"2024-05-08T21:00:02.445409+0000","last_clean":"2024-05-08T21:00:02.445409+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:02.445409+0000","last_undegraded":"2024-05-08T21:00:02.445409+0000","last_fullsized":"2024-05-08T21:00:02.445409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:09.178871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206244+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:59:50.206244+0000","last_peered":"2024-05-08T20:59:50.206244+0000","last_clean":"2024-05-08T20:59:50.206244+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:59:50.206244+0000","last_undegraded":"2024-05-08T20:59:50.206244+0000","last_fullsized":"2024-05-08T20:59:50.206244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437533+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T21:00:02.437533+0000","last_peered":"2024-05-08T21:00:02.437533+0000","last_clean":"2024-05-08T21:00:02.437533+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:02.437533+0000","last_undegraded":"2024-05-08T21:00:02.437533+0000","last_fullsized":"2024-05-08T21:00:02.437533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'73","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.174851+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T21:00:01.174851+0000","last_peered":"2024-05-08T21:00:01.174851+0000","last_clean":"2024-05-08T21:00:01.174851+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:01.174851+0000","last_undegraded":"2024-05-08T21:00:01.174851+0000","last_fullsized":"2024-05-08T21:00:01.174851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428782+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T21:00:02.428782+0000","last_peered":"2024-05-08T21:00:02.428782+0000","last_clean":"2024-05-08T21:00:02.428782+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:00:02.428782+0000","last_undegraded":"2024-05-08T21:00:02.428782+0000","last_fullsized":"2024-05-08T21:00:02.428782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206180+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:59:50.206180+0000","last_peered":"2024-05-08T20:59:50.206180+0000","last_clean":"2024-05-08T20:59:50.206180+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:59:50.206180+0000","last_undegraded":"2024-05-08T20:59:50.206180+0000","last_fullsized":"2024-05-08T20:59:50.206180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439343+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T21:00:02.439343+0000","last_peered":"2024-05-08T21:00:02.439343+0000","last_clean":"2024-05-08T21:00:02.439343+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:02.439343+0000","last_undegraded":"2024-05-08T21:00:02.439343+0000","last_fullsized":"2024-05-08T21:00:02.439343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.193955+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:59:50.193955+0000","last_peered":"2024-05-08T20:59:50.193955+0000","last_clean":"2024-05-08T20:59:50.193955+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:59:50.193955+0000","last_undegraded":"2024-05-08T20:59:50.193955+0000","last_fullsized":"2024-05-08T20:59:50.193955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441988+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T21:00:02.441988+0000","last_peered":"2024-05-08T21:00:02.441988+0000","last_clean":"2024-05-08T21:00:02.441988+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:02.441988+0000","last_undegraded":"2024-05-08T21:00:02.441988+0000","last_fullsized":"2024-05-08T21:00:02.441988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202542+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:59:50.202542+0000","last_peered":"2024-05-08T20:59:50.202542+0000","last_clean":"2024-05-08T20:59:50.202542+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:59:50.202542+0000","last_undegraded":"2024-05-08T20:59:50.202542+0000","last_fullsized":"2024-05-08T20:59:50.202542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428981+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T21:00:02.428981+0000","last_peered":"2024-05-08T21:00:02.428981+0000","last_clean":"2024-05-08T21:00:02.428981+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:02.428981+0000","last_undegraded":"2024-05-08T21:00:02.428981+0000","last_fullsized":"2024-05-08T21:00:02.428981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'40","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.379978+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T21:00:00.379978+0000","last_peered":"2024-05-08T21:00:00.379978+0000","last_clean":"2024-05-08T21:00:00.379978+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:00.379978+0000","last_undegraded":"2024-05-08T21:00:00.379978+0000","last_fullsized":"2024-05-08T21:00:00.379978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444857+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T21:00:02.444857+0000","last_peered":"2024-05-08T21:00:02.444857+0000","last_clean":"2024-05-08T21:00:02.444857+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:02.444857+0000","last_undegraded":"2024-05-08T21:00:02.444857+0000","last_fullsized":"2024-05-08T21:00:02.444857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'26","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.178249+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T21:00:01.178249+0000","last_peered":"2024-05-08T21:00:01.178249+0000","last_clean":"2024-05-08T21:00:01.178249+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:01.178249+0000","last_undegraded":"2024-05-08T21:00:01.178249+0000","last_fullsized":"2024-05-08T21:00:01.178249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433907+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T21:00:02.433907+0000","last_peered":"2024-05-08T21:00:02.433907+0000","last_clean":"2024-05-08T21:00:02.433907+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:02.433907+0000","last_undegraded":"2024-05-08T21:00:02.433907+0000","last_fullsized":"2024-05-08T21:00:02.433907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202507+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:59:50.202507+0000","last_peered":"2024-05-08T20:59:50.202507+0000","last_clean":"2024-05-08T20:59:50.202507+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:59:50.202507+0000","last_undegraded":"2024-05-08T20:59:50.202507+0000","last_fullsized":"2024-05-08T20:59:50.202507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.420471+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T21:00:02.420471+0000","last_peered":"2024-05-08T21:00:02.420471+0000","last_clean":"2024-05-08T21:00:02.420471+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:02.420471+0000","last_undegraded":"2024-05-08T21:00:02.420471+0000","last_fullsized":"2024-05-08T21:00:02.420471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:58.293039+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:59:58.293039+0000","last_peered":"2024-05-08T20:59:58.293039+0000","last_clean":"2024-05-08T20:59:58.293039+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:59:58.293039+0000","last_undegraded":"2024-05-08T20:59:58.293039+0000","last_fullsized":"2024-05-08T20:59:58.293039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.430991+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T21:00:02.430991+0000","last_peered":"2024-05-08T21:00:02.430991+0000","last_clean":"2024-05-08T21:00:02.430991+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:00:02.430991+0000","last_undegraded":"2024-05-08T21:00:02.430991+0000","last_fullsized":"2024-05-08T21:00:02.430991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.193817+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:59:50.193817+0000","last_peered":"2024-05-08T20:59:50.193817+0000","last_clean":"2024-05-08T20:59:50.193817+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:59:50.193817+0000","last_undegraded":"2024-05-08T20:59:50.193817+0000","last_fullsized":"2024-05-08T20:59:50.193817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438822+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T21:00:02.438822+0000","last_peered":"2024-05-08T21:00:02.438822+0000","last_clean":"2024-05-08T21:00:02.438822+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:02.438822+0000","last_undegraded":"2024-05-08T21:00:02.438822+0000","last_fullsized":"2024-05-08T21:00:02.438822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'518","reported_seq":532,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.203240+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:59:50.203240+0000","last_peered":"2024-05-08T20:59:50.203240+0000","last_clean":"2024-05-08T20:59:50.203240+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:59:50.203240+0000","last_undegraded":"2024-05-08T20:59:50.203240+0000","last_fullsized":"2024-05-08T20:59:50.203240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431702+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T21:00:02.431702+0000","last_peered":"2024-05-08T21:00:02.431702+0000","last_clean":"2024-05-08T21:00:02.431702+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:02.431702+0000","last_undegraded":"2024-05-08T21:00:02.431702+0000","last_fullsized":"2024-05-08T21:00:02.431702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444036+0000","last_change":"2024-05-08T20:57:23.945794+0000","last_active":"2024-05-08T21:00:02.444036+0000","last_peered":"2024-05-08T21:00:02.444036+0000","last_clean":"2024-05-08T21:00:02.444036+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:02.444036+0000","last_undegraded":"2024-05-08T21:00:02.444036+0000","last_fullsized":"2024-05-08T21:00:02.444036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:33.164158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192833+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:59:50.192833+0000","last_peered":"2024-05-08T20:59:50.192833+0000","last_clean":"2024-05-08T20:59:50.192833+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:59:50.192833+0000","last_undegraded":"2024-05-08T20:59:50.192833+0000","last_fullsized":"2024-05-08T20:59:50.192833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429835+0000","last_change":"2024-05-08T20:57:23.945132+0000","last_active":"2024-05-08T21:00:02.429835+0000","last_peered":"2024-05-08T21:00:02.429835+0000","last_clean":"2024-05-08T21:00:02.429835+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:02.429835+0000","last_undegraded":"2024-05-08T21:00:02.429835+0000","last_fullsized":"2024-05-08T21:00:02.429835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:56.195391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:11.915454+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T21:00:11.915454+0000","last_peered":"2024-05-08T21:00:11.915454+0000","last_clean":"2024-05-08T21:00:11.915454+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:11.915454+0000","last_undegraded":"2024-05-08T21:00:11.915454+0000","last_fullsized":"2024-05-08T21:00:11.915454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566303,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445227+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T21:00:02.445227+0000","last_peered":"2024-05-08T21:00:02.445227+0000","last_clean":"2024-05-08T21:00:02.445227+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:02.445227+0000","last_undegraded":"2024-05-08T21:00:02.445227+0000","last_fullsized":"2024-05-08T21:00:02.445227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:53.768715+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:59:53.768715+0000","last_peered":"2024-05-08T20:59:53.768715+0000","last_clean":"2024-05-08T20:59:53.768715+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:59:53.768715+0000","last_undegraded":"2024-05-08T20:59:53.768715+0000","last_fullsized":"2024-05-08T20:59:53.768715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T21:00:02.439978+0000","last_peered":"2024-05-08T21:00:02.439978+0000","last_clean":"2024-05-08T21:00:02.439978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:02.439978+0000","last_undegraded":"2024-05-08T21:00:02.439978+0000","last_fullsized":"2024-05-08T21:00:02.439978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194983+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:59:50.194983+0000","last_peered":"2024-05-08T20:59:50.194983+0000","last_clean":"2024-05-08T20:59:50.194983+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:59:50.194983+0000","last_undegraded":"2024-05-08T20:59:50.194983+0000","last_fullsized":"2024-05-08T20:59:50.194983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090733,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3113,"num_write_kb":31561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3820,"ondisk_log_size":3820,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77900000000000003,"15min":0.80800000000000005},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95399999999999996,"5min":1.22,"15min":1.22},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":1.254,"15min":1.254},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91300000000000003,"15min":0.93500000000000005},"min":{"1min":0.59899999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.236,"5min":1.298,"15min":1.298},"last":1.105},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.99399999999999999},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0409999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93100000000000005,"15min":0.97399999999999998},"min":{"1min":0.63,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1850000000000001,"5min":1.274,"15min":1.274},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1,"15min":1.042},"min":{"1min":0.73199999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3120000000000001,"5min":1.399,"15min":1.399},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.86699999999999999,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.042,"15min":1.0960000000000001},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1919999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3819999999999999,"5min":1.397,"15min":1.397},"last":0.997}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0680000000000001,"15min":1.095},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1519999999999999,"5min":1.425,"15min":1.425},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.121,"15min":1.1439999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5169999999999999,"5min":1.734,"15min":1.734},"last":1.075}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1519999999999999,"15min":1.1779999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.583,"5min":1.821,"15min":1.821},"last":1.179},{"interface":"front","average":{"1min":1.145,"5min":1.173,"15min":1.2010000000000001},"min":{"1min":0.84499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.202}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14038940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.88900000000000001,"15min":0.93100000000000005},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2150000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.343},"last":0.95399999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95399999999999996,"15min":0.997},"min":{"1min":0.58899999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.26,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0269999999999999},"min":{"1min":0.75900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.198,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.57899999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.626,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1100000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.58999999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.153,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0209999999999999,"15min":1.046},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2290000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.109}]},{"osd":5,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96299999999999997,"15min":0.96999999999999997},"min":{"1min":0.63,"5min":0.62,"15min":0.62},"max":{"1min":1.198,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.077,"15min":1.089},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3640000000000001,"5min":1.403,"15min":1.403},"last":1.0289999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1200000000000001,"15min":1.1419999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.369,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1060000000000001,"15min":1.119},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.3400000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0820000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.58099999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0600000000000001,"5min":1.173,"15min":1.173},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81799999999999995,"15min":0.81899999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.159,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53100000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"min":{"1min":0.55700000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.82699999999999996}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.59099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.226,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0509999999999999,"5min":1.401,"15min":1.401},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93100000000000005,"15min":0.95799999999999996},"min":{"1min":0.65500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.075,"5min":1.256,"15min":1.256},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.73699999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2150000000000001,"5min":1.341,"15min":1.341},"last":0.91200000000000003}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.129,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.004},"min":{"1min":0.75800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.224,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0669999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.052,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3320000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.071,"15min":1.0860000000000001},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1859999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.083,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4650000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.145}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80200000000000005,"15min":0.82799999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0920000000000001,"5min":1.139,"15min":1.139},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.93300000000000005},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.077,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2210000000000001,"5min":1.292,"15min":1.292},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.127,"5min":1.556,"15min":1.556},"last":1}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85899999999999999,"15min":0.89400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.079,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95799999999999996}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.169,"5min":1.613,"15min":1.613},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97899999999999998,"15min":1.0049999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.208,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":0.91800000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1200000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0640000000000001,"15min":1.0900000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.78,"15min":1.78},"last":1.2030000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.014,"15min":1.052},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.998,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.333,"5min":1.784,"15min":1.784},"last":1.2529999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3089999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.089},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1279999999999999,"15min":1.155},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4410000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.66500000000000004},"min":{"1min":0.51400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.048,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.88700000000000001}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.71499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.075,"15min":1.075},"last":0.81899999999999995}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74299999999999999,"15min":0.753},"min":{"1min":0.621,"5min":0.308,"15min":0.308},"max":{"1min":1.236,"5min":1.671,"15min":1.671},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.58199999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.302},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.002,"15min":1.02},"min":{"1min":0.69599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4950000000000001,"5min":1.522,"15min":1.522},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.72999999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.407,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0229999999999999,"15min":1.0289999999999999},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.994,"15min":1.994},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.878,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.444,"5min":2.198,"15min":2.198},"last":1.038}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.85899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4850000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1140000000000001,"15min":1.1240000000000001},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1379999999999999,"15min":1.173},"min":{"1min":0.91900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.492,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.097},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.167},"min":{"1min":0.92200000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.403,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.55100000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.101,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.081,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67100000000000004,"15min":0.68999999999999995},"min":{"1min":0.35399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.56799999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.83599999999999997}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.78000000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.4510000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97999999999999998,"15min":1},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.349,"5min":1.577,"15min":1.577},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.71899999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.49,"5min":1.8,"15min":1.8},"last":1.1759999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.016,"15min":1.0409999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4379999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.054,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3149999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.026,"15min":1.042},"min":{"1min":0.71899999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.087,"15min":1.1459999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.254,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.147}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.872,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1279999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.63200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.67400000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.67700000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":1.014},"min":{"1min":0.77700000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.341,"5min":1.901,"15min":1.901},"last":0.88100000000000001}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0569999999999999,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.298,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.034,"15min":1.04},"min":{"1min":0.84799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2170000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0640000000000001,"15min":1.0920000000000001},"min":{"1min":0.90500000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.105,"15min":1.1399999999999999},"min":{"1min":0.92000000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.371,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.1200000000000001}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.90000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.149},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.115,"15min":1.143},"min":{"1min":0.96499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6180000000000001,"5min":2.02,"15min":2.02},"last":0.92200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.317,"5min":0.251,"15min":0.251},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2989999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.82399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96199999999999997,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.92200000000000004,"15min":0.99299999999999999},"min":{"1min":0.40400000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.153,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.80500000000000005}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92600000000000005,"15min":0.92200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94799999999999995}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.077,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.64800000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.083}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0009999999999999,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.034},{"interface":"front","average":{"1min":1.038,"5min":1.212,"15min":1.327},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.526,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":1.006}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.022,"15min":1.0449999999999999},"min":{"1min":0.67600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.278,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0569999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:00:25.683 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:00:25.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.784+0000 7f2abd049700 1 Processor -- start 2024-05-08T21:00:25.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.784+0000 7f2abd049700 1 -- start start 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.784+0000 7f2abd049700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab80ce990 0x7f2ab815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.784+0000 7f2abd049700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab815eda0 con 0x7f2ab815f770 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.784+0000 7f2abd049700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab815ea70 con 0x7f2ab815afa0 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.784+0000 7f2abd049700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab815ba90 con 0x7f2ab80ce990 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abc848700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f2ab815f770 0x7f2ab80b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:56296/0 (socket says 172.21.15.107:56296) 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abc848700 1 -- 172.21.15.107:0/2413864659 learned_addr learned my addr 172.21.15.107:0/2413864659 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:25.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab77fe700 1 --2- 172.21.15.107:0/2413864659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab80ce990 0x7f2ab815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab77fe700 1 -- 172.21.15.107:0/2413864659 >> v1:172.21.15.195:6789/0 conn(0x7f2ab815afa0 legacy=0x7f2ab815b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab6ffd700 1 -- 172.21.15.107:0/2413864659 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586058673 0 0) 0x7f2ab815eda0 con 0x7f2ab815f770 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab77fe700 1 -- 172.21.15.107:0/2413864659 >> v1:172.21.15.107:6789/0 conn(0x7f2ab815f770 legacy=0x7f2ab80b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab77fe700 1 -- 172.21.15.107:0/2413864659 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab815bd40 con 0x7f2ab80ce990 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab77fe700 1 --2- 172.21.15.107:0/2413864659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab80ce990 0x7f2ab815f230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009dc0 tx=0x7f2aa000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63c10a8b9e341d64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab6ffd700 1 -- 172.21.15.107:0/2413864659 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000e070 con 0x7f2ab80ce990 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab6ffd700 1 -- 172.21.15.107:0/2413864659 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa000bad0 con 0x7f2ab80ce990 2024-05-08T21:00:25.797 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2ab6ffd700 1 -- 172.21.15.107:0/2413864659 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000be80 con 0x7f2ab80ce990 2024-05-08T21:00:25.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 -- 172.21.15.107:0/2413864659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab80ce990 msgr2=0x7f2ab815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 --2- 172.21.15.107:0/2413864659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab80ce990 0x7f2ab815f230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009dc0 tx=0x7f2aa000b330 comp rx=0 tx=0).stop 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 -- 172.21.15.107:0/2413864659 shutdown_connections 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 --2- 172.21.15.107:0/2413864659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab80ce990 0x7f2ab815f230 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 -- 172.21.15.107:0/2413864659 >> 172.21.15.107:0/2413864659 conn(0x7f2ab806c330 msgr2=0x7f2ab806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 -- 172.21.15.107:0/2413864659 shutdown_connections 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.788+0000 7f2abd049700 1 -- 172.21.15.107:0/2413864659 wait complete. 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 Processor -- start 2024-05-08T21:00:25.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 -- start start 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ab80ce990 0x7f2ab815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab815afa0 0x7f2ab81599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 0x7f2ab81524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81585e0 con 0x7f2ab815f770 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab815d640 con 0x7f2ab80ce990 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8152a30 con 0x7f2ab815afa0 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 0x7f2ab81524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 0x7f2ab81524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37950/0 (socket says 172.21.15.107:37950) 2024-05-08T21:00:25.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 -- 172.21.15.107:0/4005630557 learned_addr learned my addr 172.21.15.107:0/4005630557 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:25.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2ab77fe700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab815afa0 0x7f2ab81599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2ab7fff700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ab80ce990 0x7f2ab815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 -- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab815afa0 msgr2=0x7f2ab81599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab815afa0 0x7f2ab81599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 -- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ab80ce990 msgr2=0x7f2ab815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ab80ce990 0x7f2ab815dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 -- 172.21.15.107:0/4005630557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa0009a70 con 0x7f2ab815f770 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abc848700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 0x7f2ab81524f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c3f0 tx=0x7f2aa800c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8004a90 con 0x7f2ab815f770 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab80b2a60 con 0x7f2ab815f770 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab815cff0 con 0x7f2ab815f770 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa8004c10 con 0x7f2ab815f770 2024-05-08T21:00:25.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.792+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa80070d0 con 0x7f2ab815f770 2024-05-08T21:00:25.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.796+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab80cb7b0 con 0x7f2ab815f770 2024-05-08T21:00:25.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.796+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2aa8007230 con 0x7f2ab815f770 2024-05-08T21:00:25.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.796+0000 7f2ab4ff9700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2a9c066760 0x7f2a9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:25.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.796+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f2aa8084340 con 0x7f2ab815f770 2024-05-08T21:00:25.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.796+0000 7f2ab7fff700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2a9c066760 0x7f2a9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:25.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.800+0000 7f2ab7fff700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2a9c066760 0x7f2a9c068c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007fd0 tx=0x7f2ab0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:25.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.804+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f2aa8051630 con 0x7f2ab815f770 2024-05-08T21:00:25.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.968+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ab815c300 con 0x7f2a9c066760 2024-05-08T21:00:25.991 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.984+0000 7f2ab4ff9700 1 -- 172.21.15.107:0/4005630557 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287806 (secure 0 0 0) 0x7f2ab000f6a0 con 0x7f2a9c066760 2024-05-08T21:00:25.995 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:25.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.984+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2a9c066760 msgr2=0x7f2a9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.984+0000 7f2abd049700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2a9c066760 0x7f2a9c068c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007fd0 tx=0x7f2ab0009040 comp rx=0 tx=0).stop 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 msgr2=0x7f2ab81524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 0x7f2ab81524f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c3f0 tx=0x7f2aa800c700 comp rx=0 tx=0).stop 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 shutdown_connections 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2ab815f770 0x7f2ab81524f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2a9c066760 0x7f2a9c068c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f2ab815afa0 0x7f2ab81599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 --2- 172.21.15.107:0/4005630557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ab80ce990 0x7f2ab815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 >> 172.21.15.107:0/4005630557 conn(0x7f2ab806c330 msgr2=0x7f2ab8071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 shutdown_connections 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:25.988+0000 7f2abd049700 1 -- 172.21.15.107:0/4005630557 wait complete. 2024-05-08T21:00:25.998 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:00:26.010 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-05-08T21:00:24.774332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681101,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3272,"num_write_kb":33977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7244,"ondisk_log_size":7244,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003791"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442882+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T21:00:02.442882+0000","last_peered":"2024-05-08T21:00:02.442882+0000","last_clean":"2024-05-08T21:00:02.442882+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:00:02.442882+0000","last_undegraded":"2024-05-08T21:00:02.442882+0000","last_fullsized":"2024-05-08T21:00:02.442882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438700+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T21:00:02.438700+0000","last_peered":"2024-05-08T21:00:02.438700+0000","last_clean":"2024-05-08T21:00:02.438700+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:02.438700+0000","last_undegraded":"2024-05-08T21:00:02.438700+0000","last_fullsized":"2024-05-08T21:00:02.438700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437945+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T21:00:02.437945+0000","last_peered":"2024-05-08T21:00:02.437945+0000","last_clean":"2024-05-08T21:00:02.437945+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:00:02.437945+0000","last_undegraded":"2024-05-08T21:00:02.437945+0000","last_fullsized":"2024-05-08T21:00:02.437945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441808+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T21:00:02.441808+0000","last_peered":"2024-05-08T21:00:02.441808+0000","last_clean":"2024-05-08T21:00:02.441808+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:00:02.441808+0000","last_undegraded":"2024-05-08T21:00:02.441808+0000","last_fullsized":"2024-05-08T21:00:02.441808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443042+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T21:00:02.443042+0000","last_peered":"2024-05-08T21:00:02.443042+0000","last_clean":"2024-05-08T21:00:02.443042+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:00:02.443042+0000","last_undegraded":"2024-05-08T21:00:02.443042+0000","last_fullsized":"2024-05-08T21:00:02.443042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447313+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T21:00:02.447313+0000","last_peered":"2024-05-08T21:00:02.447313+0000","last_clean":"2024-05-08T21:00:02.447313+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:00:02.447313+0000","last_undegraded":"2024-05-08T21:00:02.447313+0000","last_fullsized":"2024-05-08T21:00:02.447313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440323+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T21:00:02.440323+0000","last_peered":"2024-05-08T21:00:02.440323+0000","last_clean":"2024-05-08T21:00:02.440323+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:00:02.440323+0000","last_undegraded":"2024-05-08T21:00:02.440323+0000","last_fullsized":"2024-05-08T21:00:02.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443423+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T21:00:02.443423+0000","last_peered":"2024-05-08T21:00:02.443423+0000","last_clean":"2024-05-08T21:00:02.443423+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:00:02.443423+0000","last_undegraded":"2024-05-08T21:00:02.443423+0000","last_fullsized":"2024-05-08T21:00:02.443423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446673+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T21:00:02.446673+0000","last_peered":"2024-05-08T21:00:02.446673+0000","last_clean":"2024-05-08T21:00:02.446673+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:00:02.446673+0000","last_undegraded":"2024-05-08T21:00:02.446673+0000","last_fullsized":"2024-05-08T21:00:02.446673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441716+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T21:00:02.441716+0000","last_peered":"2024-05-08T21:00:02.441716+0000","last_clean":"2024-05-08T21:00:02.441716+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:00:02.441716+0000","last_undegraded":"2024-05-08T21:00:02.441716+0000","last_fullsized":"2024-05-08T21:00:02.441716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441777+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T21:00:02.441777+0000","last_peered":"2024-05-08T21:00:02.441777+0000","last_clean":"2024-05-08T21:00:02.441777+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:02.441777+0000","last_undegraded":"2024-05-08T21:00:02.441777+0000","last_fullsized":"2024-05-08T21:00:02.441777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424189+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T21:00:02.424189+0000","last_peered":"2024-05-08T21:00:02.424189+0000","last_clean":"2024-05-08T21:00:02.424189+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:02.424189+0000","last_undegraded":"2024-05-08T21:00:02.424189+0000","last_fullsized":"2024-05-08T21:00:02.424189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440539+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T21:00:02.440539+0000","last_peered":"2024-05-08T21:00:02.440539+0000","last_clean":"2024-05-08T21:00:02.440539+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:02.440539+0000","last_undegraded":"2024-05-08T21:00:02.440539+0000","last_fullsized":"2024-05-08T21:00:02.440539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437433+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T21:00:02.437433+0000","last_peered":"2024-05-08T21:00:02.437433+0000","last_clean":"2024-05-08T21:00:02.437433+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:02.437433+0000","last_undegraded":"2024-05-08T21:00:02.437433+0000","last_fullsized":"2024-05-08T21:00:02.437433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.423919+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T21:00:02.423919+0000","last_peered":"2024-05-08T21:00:02.423919+0000","last_clean":"2024-05-08T21:00:02.423919+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:02.423919+0000","last_undegraded":"2024-05-08T21:00:02.423919+0000","last_fullsized":"2024-05-08T21:00:02.423919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.434610+0000","last_change":"2024-05-08T20:57:23.947280+0000","last_active":"2024-05-08T21:00:02.434610+0000","last_peered":"2024-05-08T21:00:02.434610+0000","last_clean":"2024-05-08T21:00:02.434610+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:02.434610+0000","last_undegraded":"2024-05-08T21:00:02.434610+0000","last_fullsized":"2024-05-08T21:00:02.434610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:51.369610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446463+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T21:00:02.446463+0000","last_peered":"2024-05-08T21:00:02.446463+0000","last_clean":"2024-05-08T21:00:02.446463+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:02.446463+0000","last_undegraded":"2024-05-08T21:00:02.446463+0000","last_fullsized":"2024-05-08T21:00:02.446463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.435282+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T21:00:02.435282+0000","last_peered":"2024-05-08T21:00:02.435282+0000","last_clean":"2024-05-08T21:00:02.435282+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:02.435282+0000","last_undegraded":"2024-05-08T21:00:02.435282+0000","last_fullsized":"2024-05-08T21:00:02.435282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429755+0000","last_change":"2024-05-08T20:57:23.938502+0000","last_active":"2024-05-08T21:00:02.429755+0000","last_peered":"2024-05-08T21:00:02.429755+0000","last_clean":"2024-05-08T21:00:02.429755+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:00:02.429755+0000","last_undegraded":"2024-05-08T21:00:02.429755+0000","last_fullsized":"2024-05-08T21:00:02.429755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:32.499464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433101+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T21:00:02.433101+0000","last_peered":"2024-05-08T21:00:02.433101+0000","last_clean":"2024-05-08T21:00:02.433101+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.433101+0000","last_undegraded":"2024-05-08T21:00:02.433101+0000","last_fullsized":"2024-05-08T21:00:02.433101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443357+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T21:00:02.443357+0000","last_peered":"2024-05-08T21:00:02.443357+0000","last_clean":"2024-05-08T21:00:02.443357+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:00:02.443357+0000","last_undegraded":"2024-05-08T21:00:02.443357+0000","last_fullsized":"2024-05-08T21:00:02.443357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447239+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T21:00:02.447239+0000","last_peered":"2024-05-08T21:00:02.447239+0000","last_clean":"2024-05-08T21:00:02.447239+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:00:02.447239+0000","last_undegraded":"2024-05-08T21:00:02.447239+0000","last_fullsized":"2024-05-08T21:00:02.447239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424005+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T21:00:02.424005+0000","last_peered":"2024-05-08T21:00:02.424005+0000","last_clean":"2024-05-08T21:00:02.424005+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:02.424005+0000","last_undegraded":"2024-05-08T21:00:02.424005+0000","last_fullsized":"2024-05-08T21:00:02.424005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438896+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T21:00:02.438896+0000","last_peered":"2024-05-08T21:00:02.438896+0000","last_clean":"2024-05-08T21:00:02.438896+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:02.438896+0000","last_undegraded":"2024-05-08T21:00:02.438896+0000","last_fullsized":"2024-05-08T21:00:02.438896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.422268+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T21:00:02.422268+0000","last_peered":"2024-05-08T21:00:02.422268+0000","last_clean":"2024-05-08T21:00:02.422268+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:02.422268+0000","last_undegraded":"2024-05-08T21:00:02.422268+0000","last_fullsized":"2024-05-08T21:00:02.422268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444304+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T21:00:02.444304+0000","last_peered":"2024-05-08T21:00:02.444304+0000","last_clean":"2024-05-08T21:00:02.444304+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:00:02.444304+0000","last_undegraded":"2024-05-08T21:00:02.444304+0000","last_fullsized":"2024-05-08T21:00:02.444304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431032+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T21:00:02.431032+0000","last_peered":"2024-05-08T21:00:02.431032+0000","last_clean":"2024-05-08T21:00:02.431032+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:02.431032+0000","last_undegraded":"2024-05-08T21:00:02.431032+0000","last_fullsized":"2024-05-08T21:00:02.431032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.427540+0000","last_change":"2024-05-08T20:57:23.945199+0000","last_active":"2024-05-08T21:00:02.427540+0000","last_peered":"2024-05-08T21:00:02.427540+0000","last_clean":"2024-05-08T21:00:02.427540+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:00:02.427540+0000","last_undegraded":"2024-05-08T21:00:02.427540+0000","last_fullsized":"2024-05-08T21:00:02.427540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:26.504526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439043+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T21:00:02.439043+0000","last_peered":"2024-05-08T21:00:02.439043+0000","last_clean":"2024-05-08T21:00:02.439043+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:00:02.439043+0000","last_undegraded":"2024-05-08T21:00:02.439043+0000","last_fullsized":"2024-05-08T21:00:02.439043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445362+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T21:00:02.445362+0000","last_peered":"2024-05-08T21:00:02.445362+0000","last_clean":"2024-05-08T21:00:02.445362+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:00:02.445362+0000","last_undegraded":"2024-05-08T21:00:02.445362+0000","last_fullsized":"2024-05-08T21:00:02.445362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444671+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T21:00:02.444671+0000","last_peered":"2024-05-08T21:00:02.444671+0000","last_clean":"2024-05-08T21:00:02.444671+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:02.444671+0000","last_undegraded":"2024-05-08T21:00:02.444671+0000","last_fullsized":"2024-05-08T21:00:02.444671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":82,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442467+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T21:00:02.442467+0000","last_peered":"2024-05-08T21:00:02.442467+0000","last_clean":"2024-05-08T21:00:02.442467+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:02.442467+0000","last_undegraded":"2024-05-08T21:00:02.442467+0000","last_fullsized":"2024-05-08T21:00:02.442467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428747+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T21:00:02.428747+0000","last_peered":"2024-05-08T21:00:02.428747+0000","last_clean":"2024-05-08T21:00:02.428747+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:02.428747+0000","last_undegraded":"2024-05-08T21:00:02.428747+0000","last_fullsized":"2024-05-08T21:00:02.428747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1517","reported_seq":1531,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202034+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:59:50.202034+0000","last_peered":"2024-05-08T20:59:50.202034+0000","last_clean":"2024-05-08T20:59:50.202034+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:59:50.202034+0000","last_undegraded":"2024-05-08T20:59:50.202034+0000","last_fullsized":"2024-05-08T20:59:50.202034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439140+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T21:00:02.439140+0000","last_peered":"2024-05-08T21:00:02.439140+0000","last_clean":"2024-05-08T21:00:02.439140+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:02.439140+0000","last_undegraded":"2024-05-08T21:00:02.439140+0000","last_fullsized":"2024-05-08T21:00:02.439140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188425+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:59:50.188425+0000","last_peered":"2024-05-08T20:59:50.188425+0000","last_clean":"2024-05-08T20:59:50.188425+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:59:50.188425+0000","last_undegraded":"2024-05-08T20:59:50.188425+0000","last_fullsized":"2024-05-08T20:59:50.188425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.191949+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:59:50.191949+0000","last_peered":"2024-05-08T20:59:50.191949+0000","last_clean":"2024-05-08T20:59:50.191949+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:59:50.191949+0000","last_undegraded":"2024-05-08T20:59:50.191949+0000","last_fullsized":"2024-05-08T20:59:50.191949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437829+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T21:00:02.437829+0000","last_peered":"2024-05-08T21:00:02.437829+0000","last_clean":"2024-05-08T21:00:02.437829+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:00:02.437829+0000","last_undegraded":"2024-05-08T21:00:02.437829+0000","last_fullsized":"2024-05-08T21:00:02.437829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:59:50.201560+0000","last_peered":"2024-05-08T20:59:50.201560+0000","last_clean":"2024-05-08T20:59:50.201560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:59:50.201560+0000","last_undegraded":"2024-05-08T20:59:50.201560+0000","last_fullsized":"2024-05-08T20:59:50.201560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431503+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T21:00:02.431503+0000","last_peered":"2024-05-08T21:00:02.431503+0000","last_clean":"2024-05-08T21:00:02.431503+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:02.431503+0000","last_undegraded":"2024-05-08T21:00:02.431503+0000","last_fullsized":"2024-05-08T21:00:02.431503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188688+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:59:50.188688+0000","last_peered":"2024-05-08T20:59:50.188688+0000","last_clean":"2024-05-08T20:59:50.188688+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:59:50.188688+0000","last_undegraded":"2024-05-08T20:59:50.188688+0000","last_fullsized":"2024-05-08T20:59:50.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":86,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446668+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T21:00:02.446668+0000","last_peered":"2024-05-08T21:00:02.446668+0000","last_clean":"2024-05-08T21:00:02.446668+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:02.446668+0000","last_undegraded":"2024-05-08T21:00:02.446668+0000","last_fullsized":"2024-05-08T21:00:02.446668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201606+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:59:50.201606+0000","last_peered":"2024-05-08T20:59:50.201606+0000","last_clean":"2024-05-08T20:59:50.201606+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:59:50.201606+0000","last_undegraded":"2024-05-08T20:59:50.201606+0000","last_fullsized":"2024-05-08T20:59:50.201606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445301+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T21:00:02.445301+0000","last_peered":"2024-05-08T21:00:02.445301+0000","last_clean":"2024-05-08T21:00:02.445301+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:02.445301+0000","last_undegraded":"2024-05-08T21:00:02.445301+0000","last_fullsized":"2024-05-08T21:00:02.445301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.271646+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T21:00:00.271646+0000","last_peered":"2024-05-08T21:00:00.271646+0000","last_clean":"2024-05-08T21:00:00.271646+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:00.271646+0000","last_undegraded":"2024-05-08T21:00:00.271646+0000","last_fullsized":"2024-05-08T21:00:00.271646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444429+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T21:00:02.444429+0000","last_peered":"2024-05-08T21:00:02.444429+0000","last_clean":"2024-05-08T21:00:02.444429+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:02.444429+0000","last_undegraded":"2024-05-08T21:00:02.444429+0000","last_fullsized":"2024-05-08T21:00:02.444429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'912","reported_seq":926,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:55.140352+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:59:55.140352+0000","last_peered":"2024-05-08T20:59:55.140352+0000","last_clean":"2024-05-08T20:59:55.140352+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:59:55.140352+0000","last_undegraded":"2024-05-08T20:59:55.140352+0000","last_fullsized":"2024-05-08T20:59:55.140352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442866+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442866+0000","last_peered":"2024-05-08T21:00:02.442866+0000","last_clean":"2024-05-08T21:00:02.442866+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442866+0000","last_undegraded":"2024-05-08T21:00:02.442866+0000","last_fullsized":"2024-05-08T21:00:02.442866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'17","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192139+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:59:50.192139+0000","last_peered":"2024-05-08T20:59:50.192139+0000","last_clean":"2024-05-08T20:59:50.192139+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:59:50.192139+0000","last_undegraded":"2024-05-08T20:59:50.192139+0000","last_fullsized":"2024-05-08T20:59:50.192139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443140+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T21:00:02.443140+0000","last_peered":"2024-05-08T21:00:02.443140+0000","last_clean":"2024-05-08T21:00:02.443140+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:02.443140+0000","last_undegraded":"2024-05-08T21:00:02.443140+0000","last_fullsized":"2024-05-08T21:00:02.443140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:54.089782+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:59:54.089782+0000","last_peered":"2024-05-08T20:59:54.089782+0000","last_clean":"2024-05-08T20:59:54.089782+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:59:54.089782+0000","last_undegraded":"2024-05-08T20:59:54.089782+0000","last_fullsized":"2024-05-08T20:59:54.089782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444142+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T21:00:02.444142+0000","last_peered":"2024-05-08T21:00:02.444142+0000","last_clean":"2024-05-08T21:00:02.444142+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:00:02.444142+0000","last_undegraded":"2024-05-08T21:00:02.444142+0000","last_fullsized":"2024-05-08T21:00:02.444142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.112953+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:59:56.112953+0000","last_peered":"2024-05-08T20:59:56.112953+0000","last_clean":"2024-05-08T20:59:56.112953+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:59:56.112953+0000","last_undegraded":"2024-05-08T20:59:56.112953+0000","last_fullsized":"2024-05-08T20:59:56.112953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437682+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T21:00:02.437682+0000","last_peered":"2024-05-08T21:00:02.437682+0000","last_clean":"2024-05-08T21:00:02.437682+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:02.437682+0000","last_undegraded":"2024-05-08T21:00:02.437682+0000","last_fullsized":"2024-05-08T21:00:02.437682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.146830+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:59:56.146830+0000","last_peered":"2024-05-08T20:59:56.146830+0000","last_clean":"2024-05-08T20:59:56.146830+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:59:56.146830+0000","last_undegraded":"2024-05-08T20:59:56.146830+0000","last_fullsized":"2024-05-08T20:59:56.146830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442900+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T21:00:02.442900+0000","last_peered":"2024-05-08T21:00:02.442900+0000","last_clean":"2024-05-08T21:00:02.442900+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.442900+0000","last_undegraded":"2024-05-08T21:00:02.442900+0000","last_fullsized":"2024-05-08T21:00:02.442900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194192+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:59:50.194192+0000","last_peered":"2024-05-08T20:59:50.194192+0000","last_clean":"2024-05-08T20:59:50.194192+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:59:50.194192+0000","last_undegraded":"2024-05-08T20:59:50.194192+0000","last_fullsized":"2024-05-08T20:59:50.194192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442829+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T21:00:02.442829+0000","last_peered":"2024-05-08T21:00:02.442829+0000","last_clean":"2024-05-08T21:00:02.442829+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:02.442829+0000","last_undegraded":"2024-05-08T21:00:02.442829+0000","last_fullsized":"2024-05-08T21:00:02.442829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202258+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:59:50.202258+0000","last_peered":"2024-05-08T20:59:50.202258+0000","last_clean":"2024-05-08T20:59:50.202258+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:59:50.202258+0000","last_undegraded":"2024-05-08T20:59:50.202258+0000","last_fullsized":"2024-05-08T20:59:50.202258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443122+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T21:00:02.443122+0000","last_peered":"2024-05-08T21:00:02.443122+0000","last_clean":"2024-05-08T21:00:02.443122+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:00:02.443122+0000","last_undegraded":"2024-05-08T21:00:02.443122+0000","last_fullsized":"2024-05-08T21:00:02.443122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.199275+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:59:50.199275+0000","last_peered":"2024-05-08T20:59:50.199275+0000","last_clean":"2024-05-08T20:59:50.199275+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:59:50.199275+0000","last_undegraded":"2024-05-08T20:59:50.199275+0000","last_fullsized":"2024-05-08T20:59:50.199275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441899+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T21:00:02.441899+0000","last_peered":"2024-05-08T21:00:02.441899+0000","last_clean":"2024-05-08T21:00:02.441899+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:02.441899+0000","last_undegraded":"2024-05-08T21:00:02.441899+0000","last_fullsized":"2024-05-08T21:00:02.441899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196209+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:59:50.196209+0000","last_peered":"2024-05-08T20:59:50.196209+0000","last_clean":"2024-05-08T20:59:50.196209+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:59:50.196209+0000","last_undegraded":"2024-05-08T20:59:50.196209+0000","last_fullsized":"2024-05-08T20:59:50.196209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442928+0000","last_change":"2024-05-08T20:57:23.939637+0000","last_active":"2024-05-08T21:00:02.442928+0000","last_peered":"2024-05-08T21:00:02.442928+0000","last_clean":"2024-05-08T21:00:02.442928+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:00:02.442928+0000","last_undegraded":"2024-05-08T21:00:02.442928+0000","last_fullsized":"2024-05-08T21:00:02.442928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:34.651453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:57:23.936478+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:57:23.936478+0000","last_peered":"2024-05-08T20:57:23.936478+0000","last_clean":"2024-05-08T20:57:23.936478+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:57:23.936478+0000","last_undegraded":"2024-05-08T20:57:23.936478+0000","last_fullsized":"2024-05-08T20:57:23.936478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196651+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:59:50.196651+0000","last_peered":"2024-05-08T20:59:50.196651+0000","last_clean":"2024-05-08T20:59:50.196651+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:59:50.196651+0000","last_undegraded":"2024-05-08T20:59:50.196651+0000","last_fullsized":"2024-05-08T20:59:50.196651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445409+0000","last_change":"2024-05-08T20:57:23.937184+0000","last_active":"2024-05-08T21:00:02.445409+0000","last_peered":"2024-05-08T21:00:02.445409+0000","last_clean":"2024-05-08T21:00:02.445409+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:02.445409+0000","last_undegraded":"2024-05-08T21:00:02.445409+0000","last_fullsized":"2024-05-08T21:00:02.445409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:09.178871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206244+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:59:50.206244+0000","last_peered":"2024-05-08T20:59:50.206244+0000","last_clean":"2024-05-08T20:59:50.206244+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:59:50.206244+0000","last_undegraded":"2024-05-08T20:59:50.206244+0000","last_fullsized":"2024-05-08T20:59:50.206244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437533+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T21:00:02.437533+0000","last_peered":"2024-05-08T21:00:02.437533+0000","last_clean":"2024-05-08T21:00:02.437533+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:02.437533+0000","last_undegraded":"2024-05-08T21:00:02.437533+0000","last_fullsized":"2024-05-08T21:00:02.437533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'73","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.174851+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T21:00:01.174851+0000","last_peered":"2024-05-08T21:00:01.174851+0000","last_clean":"2024-05-08T21:00:01.174851+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:01.174851+0000","last_undegraded":"2024-05-08T21:00:01.174851+0000","last_fullsized":"2024-05-08T21:00:01.174851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428782+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T21:00:02.428782+0000","last_peered":"2024-05-08T21:00:02.428782+0000","last_clean":"2024-05-08T21:00:02.428782+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:00:02.428782+0000","last_undegraded":"2024-05-08T21:00:02.428782+0000","last_fullsized":"2024-05-08T21:00:02.428782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206180+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:59:50.206180+0000","last_peered":"2024-05-08T20:59:50.206180+0000","last_clean":"2024-05-08T20:59:50.206180+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:59:50.206180+0000","last_undegraded":"2024-05-08T20:59:50.206180+0000","last_fullsized":"2024-05-08T20:59:50.206180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439343+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T21:00:02.439343+0000","last_peered":"2024-05-08T21:00:02.439343+0000","last_clean":"2024-05-08T21:00:02.439343+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:02.439343+0000","last_undegraded":"2024-05-08T21:00:02.439343+0000","last_fullsized":"2024-05-08T21:00:02.439343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.193955+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:59:50.193955+0000","last_peered":"2024-05-08T20:59:50.193955+0000","last_clean":"2024-05-08T20:59:50.193955+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:59:50.193955+0000","last_undegraded":"2024-05-08T20:59:50.193955+0000","last_fullsized":"2024-05-08T20:59:50.193955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441988+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T21:00:02.441988+0000","last_peered":"2024-05-08T21:00:02.441988+0000","last_clean":"2024-05-08T21:00:02.441988+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:02.441988+0000","last_undegraded":"2024-05-08T21:00:02.441988+0000","last_fullsized":"2024-05-08T21:00:02.441988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202542+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:59:50.202542+0000","last_peered":"2024-05-08T20:59:50.202542+0000","last_clean":"2024-05-08T20:59:50.202542+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:59:50.202542+0000","last_undegraded":"2024-05-08T20:59:50.202542+0000","last_fullsized":"2024-05-08T20:59:50.202542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428981+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T21:00:02.428981+0000","last_peered":"2024-05-08T21:00:02.428981+0000","last_clean":"2024-05-08T21:00:02.428981+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:02.428981+0000","last_undegraded":"2024-05-08T21:00:02.428981+0000","last_fullsized":"2024-05-08T21:00:02.428981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'40","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.379978+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T21:00:00.379978+0000","last_peered":"2024-05-08T21:00:00.379978+0000","last_clean":"2024-05-08T21:00:00.379978+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:00.379978+0000","last_undegraded":"2024-05-08T21:00:00.379978+0000","last_fullsized":"2024-05-08T21:00:00.379978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444857+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T21:00:02.444857+0000","last_peered":"2024-05-08T21:00:02.444857+0000","last_clean":"2024-05-08T21:00:02.444857+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:02.444857+0000","last_undegraded":"2024-05-08T21:00:02.444857+0000","last_fullsized":"2024-05-08T21:00:02.444857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'26","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.178249+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T21:00:01.178249+0000","last_peered":"2024-05-08T21:00:01.178249+0000","last_clean":"2024-05-08T21:00:01.178249+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:01.178249+0000","last_undegraded":"2024-05-08T21:00:01.178249+0000","last_fullsized":"2024-05-08T21:00:01.178249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433907+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T21:00:02.433907+0000","last_peered":"2024-05-08T21:00:02.433907+0000","last_clean":"2024-05-08T21:00:02.433907+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:02.433907+0000","last_undegraded":"2024-05-08T21:00:02.433907+0000","last_fullsized":"2024-05-08T21:00:02.433907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202507+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:59:50.202507+0000","last_peered":"2024-05-08T20:59:50.202507+0000","last_clean":"2024-05-08T20:59:50.202507+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:59:50.202507+0000","last_undegraded":"2024-05-08T20:59:50.202507+0000","last_fullsized":"2024-05-08T20:59:50.202507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.420471+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T21:00:02.420471+0000","last_peered":"2024-05-08T21:00:02.420471+0000","last_clean":"2024-05-08T21:00:02.420471+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:02.420471+0000","last_undegraded":"2024-05-08T21:00:02.420471+0000","last_fullsized":"2024-05-08T21:00:02.420471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:58.293039+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:59:58.293039+0000","last_peered":"2024-05-08T20:59:58.293039+0000","last_clean":"2024-05-08T20:59:58.293039+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:59:58.293039+0000","last_undegraded":"2024-05-08T20:59:58.293039+0000","last_fullsized":"2024-05-08T20:59:58.293039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.430991+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T21:00:02.430991+0000","last_peered":"2024-05-08T21:00:02.430991+0000","last_clean":"2024-05-08T21:00:02.430991+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:00:02.430991+0000","last_undegraded":"2024-05-08T21:00:02.430991+0000","last_fullsized":"2024-05-08T21:00:02.430991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.193817+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:59:50.193817+0000","last_peered":"2024-05-08T20:59:50.193817+0000","last_clean":"2024-05-08T20:59:50.193817+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:59:50.193817+0000","last_undegraded":"2024-05-08T20:59:50.193817+0000","last_fullsized":"2024-05-08T20:59:50.193817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438822+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T21:00:02.438822+0000","last_peered":"2024-05-08T21:00:02.438822+0000","last_clean":"2024-05-08T21:00:02.438822+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:02.438822+0000","last_undegraded":"2024-05-08T21:00:02.438822+0000","last_fullsized":"2024-05-08T21:00:02.438822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'518","reported_seq":532,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.203240+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:59:50.203240+0000","last_peered":"2024-05-08T20:59:50.203240+0000","last_clean":"2024-05-08T20:59:50.203240+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:59:50.203240+0000","last_undegraded":"2024-05-08T20:59:50.203240+0000","last_fullsized":"2024-05-08T20:59:50.203240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431702+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T21:00:02.431702+0000","last_peered":"2024-05-08T21:00:02.431702+0000","last_clean":"2024-05-08T21:00:02.431702+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:02.431702+0000","last_undegraded":"2024-05-08T21:00:02.431702+0000","last_fullsized":"2024-05-08T21:00:02.431702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444036+0000","last_change":"2024-05-08T20:57:23.945794+0000","last_active":"2024-05-08T21:00:02.444036+0000","last_peered":"2024-05-08T21:00:02.444036+0000","last_clean":"2024-05-08T21:00:02.444036+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:02.444036+0000","last_undegraded":"2024-05-08T21:00:02.444036+0000","last_fullsized":"2024-05-08T21:00:02.444036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:33.164158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192833+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:59:50.192833+0000","last_peered":"2024-05-08T20:59:50.192833+0000","last_clean":"2024-05-08T20:59:50.192833+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:59:50.192833+0000","last_undegraded":"2024-05-08T20:59:50.192833+0000","last_fullsized":"2024-05-08T20:59:50.192833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429835+0000","last_change":"2024-05-08T20:57:23.945132+0000","last_active":"2024-05-08T21:00:02.429835+0000","last_peered":"2024-05-08T21:00:02.429835+0000","last_clean":"2024-05-08T21:00:02.429835+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:02.429835+0000","last_undegraded":"2024-05-08T21:00:02.429835+0000","last_fullsized":"2024-05-08T21:00:02.429835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:56.195391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:11.915454+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T21:00:11.915454+0000","last_peered":"2024-05-08T21:00:11.915454+0000","last_clean":"2024-05-08T21:00:11.915454+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:11.915454+0000","last_undegraded":"2024-05-08T21:00:11.915454+0000","last_fullsized":"2024-05-08T21:00:11.915454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566303,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445227+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T21:00:02.445227+0000","last_peered":"2024-05-08T21:00:02.445227+0000","last_clean":"2024-05-08T21:00:02.445227+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:02.445227+0000","last_undegraded":"2024-05-08T21:00:02.445227+0000","last_fullsized":"2024-05-08T21:00:02.445227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:53.768715+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:59:53.768715+0000","last_peered":"2024-05-08T20:59:53.768715+0000","last_clean":"2024-05-08T20:59:53.768715+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:59:53.768715+0000","last_undegraded":"2024-05-08T20:59:53.768715+0000","last_fullsized":"2024-05-08T20:59:53.768715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T21:00:02.439978+0000","last_peered":"2024-05-08T21:00:02.439978+0000","last_clean":"2024-05-08T21:00:02.439978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:02.439978+0000","last_undegraded":"2024-05-08T21:00:02.439978+0000","last_fullsized":"2024-05-08T21:00:02.439978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194983+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:59:50.194983+0000","last_peered":"2024-05-08T20:59:50.194983+0000","last_clean":"2024-05-08T20:59:50.194983+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:59:50.194983+0000","last_undegraded":"2024-05-08T20:59:50.194983+0000","last_fullsized":"2024-05-08T20:59:50.194983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090733,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3113,"num_write_kb":31561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3820,"ondisk_log_size":3820,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77900000000000003,"15min":0.80800000000000005},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95399999999999996,"5min":1.22,"15min":1.22},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":1.254,"15min":1.254},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91300000000000003,"15min":0.93500000000000005},"min":{"1min":0.59899999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.236,"5min":1.298,"15min":1.298},"last":1.105},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.99399999999999999},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0409999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93100000000000005,"15min":0.97399999999999998},"min":{"1min":0.63,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1850000000000001,"5min":1.274,"15min":1.274},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1,"15min":1.042},"min":{"1min":0.73199999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3120000000000001,"5min":1.399,"15min":1.399},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.86699999999999999,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.042,"15min":1.0960000000000001},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1919999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3819999999999999,"5min":1.397,"15min":1.397},"last":0.997}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0680000000000001,"15min":1.095},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1519999999999999,"5min":1.425,"15min":1.425},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.121,"15min":1.1439999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5169999999999999,"5min":1.734,"15min":1.734},"last":1.075}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1519999999999999,"15min":1.1779999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.583,"5min":1.821,"15min":1.821},"last":1.179},{"interface":"front","average":{"1min":1.145,"5min":1.173,"15min":1.2010000000000001},"min":{"1min":0.84499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.202}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14038940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.88900000000000001,"15min":0.93100000000000005},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2150000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.343},"last":0.95399999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95399999999999996,"15min":0.997},"min":{"1min":0.58899999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.26,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0269999999999999},"min":{"1min":0.75900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.198,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.57899999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.626,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1100000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.58999999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.153,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0209999999999999,"15min":1.046},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2290000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.109}]},{"osd":5,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96299999999999997,"15min":0.96999999999999997},"min":{"1min":0.63,"5min":0.62,"15min":0.62},"max":{"1min":1.198,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.077,"15min":1.089},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3640000000000001,"5min":1.403,"15min":1.403},"last":1.0289999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1200000000000001,"15min":1.1419999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.369,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1060000000000001,"15min":1.119},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.3400000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0820000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.58099999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0600000000000001,"5min":1.173,"15min":1.173},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81799999999999995,"15min":0.81899999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.159,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53100000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"min":{"1min":0.55700000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.82699999999999996}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.59099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.226,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0509999999999999,"5min":1.401,"15min":1.401},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93100000000000005,"15min":0.95799999999999996},"min":{"1min":0.65500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.075,"5min":1.256,"15min":1.256},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.73699999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2150000000000001,"5min":1.341,"15min":1.341},"last":0.91200000000000003}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.129,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.004},"min":{"1min":0.75800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.224,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0669999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.052,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3320000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.071,"15min":1.0860000000000001},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1859999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.083,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4650000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.145}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80200000000000005,"15min":0.82799999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0920000000000001,"5min":1.139,"15min":1.139},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.93300000000000005},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.077,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2210000000000001,"5min":1.292,"15min":1.292},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.127,"5min":1.556,"15min":1.556},"last":1}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85899999999999999,"15min":0.89400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.079,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95799999999999996}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.169,"5min":1.613,"15min":1.613},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97899999999999998,"15min":1.0049999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.208,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":0.91800000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1200000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0640000000000001,"15min":1.0900000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.78,"15min":1.78},"last":1.2030000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.014,"15min":1.052},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.998,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.333,"5min":1.784,"15min":1.784},"last":1.2529999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3089999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.089},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1279999999999999,"15min":1.155},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4410000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.66500000000000004},"min":{"1min":0.51400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.048,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.88700000000000001}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.71499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.075,"15min":1.075},"last":0.81899999999999995}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74299999999999999,"15min":0.753},"min":{"1min":0.621,"5min":0.308,"15min":0.308},"max":{"1min":1.236,"5min":1.671,"15min":1.671},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.58199999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.302},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.002,"15min":1.02},"min":{"1min":0.69599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4950000000000001,"5min":1.522,"15min":1.522},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.72999999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.407,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0229999999999999,"15min":1.0289999999999999},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.994,"15min":1.994},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.878,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.444,"5min":2.198,"15min":2.198},"last":1.038}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.85899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4850000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1140000000000001,"15min":1.1240000000000001},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1379999999999999,"15min":1.173},"min":{"1min":0.91900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.492,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.097},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.167},"min":{"1min":0.92200000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.403,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.55100000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.101,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.081,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67100000000000004,"15min":0.68999999999999995},"min":{"1min":0.35399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.56799999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.83599999999999997}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.78000000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.4510000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97999999999999998,"15min":1},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.349,"5min":1.577,"15min":1.577},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.71899999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.49,"5min":1.8,"15min":1.8},"last":1.1759999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.016,"15min":1.0409999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4379999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.054,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3149999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.026,"15min":1.042},"min":{"1min":0.71899999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.087,"15min":1.1459999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.254,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.147}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.872,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1279999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.63200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.67400000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.67700000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":1.014},"min":{"1min":0.77700000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.341,"5min":1.901,"15min":1.901},"last":0.88100000000000001}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0569999999999999,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.298,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.034,"15min":1.04},"min":{"1min":0.84799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2170000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0640000000000001,"15min":1.0920000000000001},"min":{"1min":0.90500000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.105,"15min":1.1399999999999999},"min":{"1min":0.92000000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.371,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.1200000000000001}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.90000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.149},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.115,"15min":1.143},"min":{"1min":0.96499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6180000000000001,"5min":2.02,"15min":2.02},"last":0.92200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.317,"5min":0.251,"15min":0.251},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2989999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.82399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96199999999999997,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.92200000000000004,"15min":0.99299999999999999},"min":{"1min":0.40400000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.153,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.80500000000000005}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92600000000000005,"15min":0.92200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94799999999999995}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.077,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.64800000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.083}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0009999999999999,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.034},{"interface":"front","average":{"1min":1.038,"5min":1.212,"15min":1.327},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.526,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":1.006}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.022,"15min":1.0449999999999999},"min":{"1min":0.67600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.278,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0569999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:00:26.015 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T21:00:26.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:00:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 Processor -- start 2024-05-08T21:00:26.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 -- start start 2024-05-08T21:00:26.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e58038820 0x7f8e580073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e58051010 0x7f8e5804bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e580078e0 con 0x7f8e580e11d0 2024-05-08T21:00:26.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e58006f10 con 0x7f8e58051010 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e64a0f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580e15b0 con 0x7f8e58038820 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e5ffff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e58051010 0x7f8e5804bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e58038820 0x7f8e580073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e5ffff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f8e58051010 0x7f8e5804bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:55750/0 (socket says 172.21.15.107:55750) 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e5ffff700 1 -- 172.21.15.107:0/331826759 learned_addr learned my addr 172.21.15.107:0/331826759 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e5effd700 1 --2- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e58038820 0x7f8e580073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:41734/0 (socket says 172.21.15.107:41734) 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.120+0000 7f8e5f7fe700 1 --1- 172.21.15.107:0/331826759 >> v1:172.21.15.195:6789/0 conn(0x7f8e580e11d0 0x7f8e58039f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:56428/0 (socket says 172.21.15.107:56428) 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5ffff700 1 -- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e58038820 msgr2=0x7f8e580073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5ffff700 1 --2- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e58038820 0x7f8e580073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5ffff700 1 -- 172.21.15.107:0/331826759 >> v1:172.21.15.195:6789/0 conn(0x7f8e580e11d0 legacy=0x7f8e58039f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5ffff700 1 -- 172.21.15.107:0/331826759 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58006300 con 0x7f8e58051010 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5ffff700 1 --2- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58051010 0x7f8e5804bc40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e600698a0 tx=0x7f8e60068970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ff1f261eb0d0c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:26.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5e7fc700 1 -- 172.21.15.107:0/331826759 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60068790 con 0x7f8e58051010 2024-05-08T21:00:26.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5e7fc700 1 -- 172.21.15.107:0/331826759 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e600679b0 con 0x7f8e58051010 2024-05-08T21:00:26.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e5e7fc700 1 -- 172.21.15.107:0/331826759 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60067d20 con 0x7f8e58051010 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 -- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58051010 msgr2=0x7f8e5804bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58051010 0x7f8e5804bc40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e600698a0 tx=0x7f8e60068970 comp rx=0 tx=0).stop 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 -- 172.21.15.107:0/331826759 shutdown_connections 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58051010 0x7f8e5804bc40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/331826759 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e58038820 0x7f8e580073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 -- 172.21.15.107:0/331826759 >> 172.21.15.107:0/331826759 conn(0x7f8e58054b70 msgr2=0x7f8e58054f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 -- 172.21.15.107:0/331826759 shutdown_connections 2024-05-08T21:00:26.134 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 -- 172.21.15.107:0/331826759 wait complete. 2024-05-08T21:00:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 Processor -- start 2024-05-08T21:00:26.135 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.124+0000 7f8e64a0f700 1 -- start start 2024-05-08T21:00:26.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58038820 0x7f8e580c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 0x7f8e58176e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e580e11d0 0x7f8e580dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5804a0a0 con 0x7f8e58051010 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580c9400 con 0x7f8e58038820 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5804a310 con 0x7f8e580e11d0 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 0x7f8e58176e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 0x7f8e58176e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37964/0 (socket says 172.21.15.107:37964) 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 -- 172.21.15.107:0/1890457077 learned_addr learned my addr 172.21.15.107:0/1890457077 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5f7fe700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58038820 0x7f8e580c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5ffff700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e580e11d0 0x7f8e580dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 -- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e580e11d0 msgr2=0x7f8e580dc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e580e11d0 0x7f8e580dc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 -- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58038820 msgr2=0x7f8e580c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58038820 0x7f8e580c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 -- 172.21.15.107:0/1890457077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6004f5c0 con 0x7f8e58051010 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e5effd700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 0x7f8e58176e40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000e840 tx=0x7f8e5000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e500095a0 con 0x7f8e58051010 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e50013680 con 0x7f8e58051010 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5804a5f0 con 0x7f8e58051010 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e500139f0 con 0x7f8e58051010 2024-05-08T21:00:26.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e580d75d0 con 0x7f8e58051010 2024-05-08T21:00:26.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.128+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e58005440 con 0x7f8e58051010 2024-05-08T21:00:26.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.132+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e50013b50 con 0x7f8e58051010 2024-05-08T21:00:26.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.132+0000 7f8e47fff700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8e4c066730 0x7f8e4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.132+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f8e500847a0 con 0x7f8e58051010 2024-05-08T21:00:26.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.132+0000 7f8e5f7fe700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8e4c066730 0x7f8e4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.132+0000 7f8e5f7fe700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8e4c066730 0x7f8e4c068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e54000f60 tx=0x7f8e54007f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:26.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.136+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f8e50051b20 con 0x7f8e58051010 2024-05-08T21:00:26.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.304+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e58006ba0 con 0x7f8e4c066730 2024-05-08T21:00:26.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.312+0000 7f8e47fff700 1 -- 172.21.15.107:0/1890457077 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287806 (secure 0 0 0) 0x7f8e54004b30 con 0x7f8e4c066730 2024-05-08T21:00:26.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8e4c066730 msgr2=0x7f8e4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8e4c066730 0x7f8e4c068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e54000f60 tx=0x7f8e54007f30 comp rx=0 tx=0).stop 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 msgr2=0x7f8e58176e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 0x7f8e58176e40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000e840 tx=0x7f8e5000eb50 comp rx=0 tx=0).stop 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 shutdown_connections 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f8e4c066730 0x7f8e4c068bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f8e580e11d0 0x7f8e580dc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8e58051010 0x7f8e58176e40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 --2- 172.21.15.107:0/1890457077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e58038820 0x7f8e580c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 >> 172.21.15.107:0/1890457077 conn(0x7f8e58054b70 msgr2=0x7f8e5804def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 shutdown_connections 2024-05-08T21:00:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.320+0000 7f8e64a0f700 1 -- 172.21.15.107:0/1890457077 wait complete. 2024-05-08T21:00:26.330 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:00:26.343 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-05-08T21:00:24.774332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681101,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3272,"num_write_kb":33977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7244,"ondisk_log_size":7244,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003791"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442882+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T21:00:02.442882+0000","last_peered":"2024-05-08T21:00:02.442882+0000","last_clean":"2024-05-08T21:00:02.442882+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:00:02.442882+0000","last_undegraded":"2024-05-08T21:00:02.442882+0000","last_fullsized":"2024-05-08T21:00:02.442882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438700+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T21:00:02.438700+0000","last_peered":"2024-05-08T21:00:02.438700+0000","last_clean":"2024-05-08T21:00:02.438700+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:02.438700+0000","last_undegraded":"2024-05-08T21:00:02.438700+0000","last_fullsized":"2024-05-08T21:00:02.438700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437945+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T21:00:02.437945+0000","last_peered":"2024-05-08T21:00:02.437945+0000","last_clean":"2024-05-08T21:00:02.437945+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:00:02.437945+0000","last_undegraded":"2024-05-08T21:00:02.437945+0000","last_fullsized":"2024-05-08T21:00:02.437945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441808+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T21:00:02.441808+0000","last_peered":"2024-05-08T21:00:02.441808+0000","last_clean":"2024-05-08T21:00:02.441808+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:00:02.441808+0000","last_undegraded":"2024-05-08T21:00:02.441808+0000","last_fullsized":"2024-05-08T21:00:02.441808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443042+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T21:00:02.443042+0000","last_peered":"2024-05-08T21:00:02.443042+0000","last_clean":"2024-05-08T21:00:02.443042+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:00:02.443042+0000","last_undegraded":"2024-05-08T21:00:02.443042+0000","last_fullsized":"2024-05-08T21:00:02.443042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447313+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T21:00:02.447313+0000","last_peered":"2024-05-08T21:00:02.447313+0000","last_clean":"2024-05-08T21:00:02.447313+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:00:02.447313+0000","last_undegraded":"2024-05-08T21:00:02.447313+0000","last_fullsized":"2024-05-08T21:00:02.447313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440323+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T21:00:02.440323+0000","last_peered":"2024-05-08T21:00:02.440323+0000","last_clean":"2024-05-08T21:00:02.440323+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:00:02.440323+0000","last_undegraded":"2024-05-08T21:00:02.440323+0000","last_fullsized":"2024-05-08T21:00:02.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443423+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T21:00:02.443423+0000","last_peered":"2024-05-08T21:00:02.443423+0000","last_clean":"2024-05-08T21:00:02.443423+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:00:02.443423+0000","last_undegraded":"2024-05-08T21:00:02.443423+0000","last_fullsized":"2024-05-08T21:00:02.443423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446673+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T21:00:02.446673+0000","last_peered":"2024-05-08T21:00:02.446673+0000","last_clean":"2024-05-08T21:00:02.446673+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:00:02.446673+0000","last_undegraded":"2024-05-08T21:00:02.446673+0000","last_fullsized":"2024-05-08T21:00:02.446673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441716+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T21:00:02.441716+0000","last_peered":"2024-05-08T21:00:02.441716+0000","last_clean":"2024-05-08T21:00:02.441716+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:00:02.441716+0000","last_undegraded":"2024-05-08T21:00:02.441716+0000","last_fullsized":"2024-05-08T21:00:02.441716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441777+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T21:00:02.441777+0000","last_peered":"2024-05-08T21:00:02.441777+0000","last_clean":"2024-05-08T21:00:02.441777+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:02.441777+0000","last_undegraded":"2024-05-08T21:00:02.441777+0000","last_fullsized":"2024-05-08T21:00:02.441777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424189+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T21:00:02.424189+0000","last_peered":"2024-05-08T21:00:02.424189+0000","last_clean":"2024-05-08T21:00:02.424189+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:02.424189+0000","last_undegraded":"2024-05-08T21:00:02.424189+0000","last_fullsized":"2024-05-08T21:00:02.424189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440539+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T21:00:02.440539+0000","last_peered":"2024-05-08T21:00:02.440539+0000","last_clean":"2024-05-08T21:00:02.440539+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:02.440539+0000","last_undegraded":"2024-05-08T21:00:02.440539+0000","last_fullsized":"2024-05-08T21:00:02.440539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437433+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T21:00:02.437433+0000","last_peered":"2024-05-08T21:00:02.437433+0000","last_clean":"2024-05-08T21:00:02.437433+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:02.437433+0000","last_undegraded":"2024-05-08T21:00:02.437433+0000","last_fullsized":"2024-05-08T21:00:02.437433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.423919+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T21:00:02.423919+0000","last_peered":"2024-05-08T21:00:02.423919+0000","last_clean":"2024-05-08T21:00:02.423919+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:02.423919+0000","last_undegraded":"2024-05-08T21:00:02.423919+0000","last_fullsized":"2024-05-08T21:00:02.423919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.434610+0000","last_change":"2024-05-08T20:57:23.947280+0000","last_active":"2024-05-08T21:00:02.434610+0000","last_peered":"2024-05-08T21:00:02.434610+0000","last_clean":"2024-05-08T21:00:02.434610+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:02.434610+0000","last_undegraded":"2024-05-08T21:00:02.434610+0000","last_fullsized":"2024-05-08T21:00:02.434610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:51.369610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446463+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T21:00:02.446463+0000","last_peered":"2024-05-08T21:00:02.446463+0000","last_clean":"2024-05-08T21:00:02.446463+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:02.446463+0000","last_undegraded":"2024-05-08T21:00:02.446463+0000","last_fullsized":"2024-05-08T21:00:02.446463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.435282+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T21:00:02.435282+0000","last_peered":"2024-05-08T21:00:02.435282+0000","last_clean":"2024-05-08T21:00:02.435282+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:02.435282+0000","last_undegraded":"2024-05-08T21:00:02.435282+0000","last_fullsized":"2024-05-08T21:00:02.435282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429755+0000","last_change":"2024-05-08T20:57:23.938502+0000","last_active":"2024-05-08T21:00:02.429755+0000","last_peered":"2024-05-08T21:00:02.429755+0000","last_clean":"2024-05-08T21:00:02.429755+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:00:02.429755+0000","last_undegraded":"2024-05-08T21:00:02.429755+0000","last_fullsized":"2024-05-08T21:00:02.429755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:32.499464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433101+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T21:00:02.433101+0000","last_peered":"2024-05-08T21:00:02.433101+0000","last_clean":"2024-05-08T21:00:02.433101+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.433101+0000","last_undegraded":"2024-05-08T21:00:02.433101+0000","last_fullsized":"2024-05-08T21:00:02.433101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443357+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T21:00:02.443357+0000","last_peered":"2024-05-08T21:00:02.443357+0000","last_clean":"2024-05-08T21:00:02.443357+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:00:02.443357+0000","last_undegraded":"2024-05-08T21:00:02.443357+0000","last_fullsized":"2024-05-08T21:00:02.443357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:20.454280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447239+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T21:00:02.447239+0000","last_peered":"2024-05-08T21:00:02.447239+0000","last_clean":"2024-05-08T21:00:02.447239+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:00:02.447239+0000","last_undegraded":"2024-05-08T21:00:02.447239+0000","last_fullsized":"2024-05-08T21:00:02.447239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424005+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T21:00:02.424005+0000","last_peered":"2024-05-08T21:00:02.424005+0000","last_clean":"2024-05-08T21:00:02.424005+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:02.424005+0000","last_undegraded":"2024-05-08T21:00:02.424005+0000","last_fullsized":"2024-05-08T21:00:02.424005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438896+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T21:00:02.438896+0000","last_peered":"2024-05-08T21:00:02.438896+0000","last_clean":"2024-05-08T21:00:02.438896+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:02.438896+0000","last_undegraded":"2024-05-08T21:00:02.438896+0000","last_fullsized":"2024-05-08T21:00:02.438896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.422268+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T21:00:02.422268+0000","last_peered":"2024-05-08T21:00:02.422268+0000","last_clean":"2024-05-08T21:00:02.422268+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:02.422268+0000","last_undegraded":"2024-05-08T21:00:02.422268+0000","last_fullsized":"2024-05-08T21:00:02.422268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444304+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T21:00:02.444304+0000","last_peered":"2024-05-08T21:00:02.444304+0000","last_clean":"2024-05-08T21:00:02.444304+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:00:02.444304+0000","last_undegraded":"2024-05-08T21:00:02.444304+0000","last_fullsized":"2024-05-08T21:00:02.444304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431032+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T21:00:02.431032+0000","last_peered":"2024-05-08T21:00:02.431032+0000","last_clean":"2024-05-08T21:00:02.431032+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:02.431032+0000","last_undegraded":"2024-05-08T21:00:02.431032+0000","last_fullsized":"2024-05-08T21:00:02.431032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.427540+0000","last_change":"2024-05-08T20:57:23.945199+0000","last_active":"2024-05-08T21:00:02.427540+0000","last_peered":"2024-05-08T21:00:02.427540+0000","last_clean":"2024-05-08T21:00:02.427540+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:00:02.427540+0000","last_undegraded":"2024-05-08T21:00:02.427540+0000","last_fullsized":"2024-05-08T21:00:02.427540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:26.504526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439043+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T21:00:02.439043+0000","last_peered":"2024-05-08T21:00:02.439043+0000","last_clean":"2024-05-08T21:00:02.439043+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:00:02.439043+0000","last_undegraded":"2024-05-08T21:00:02.439043+0000","last_fullsized":"2024-05-08T21:00:02.439043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445362+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T21:00:02.445362+0000","last_peered":"2024-05-08T21:00:02.445362+0000","last_clean":"2024-05-08T21:00:02.445362+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:00:02.445362+0000","last_undegraded":"2024-05-08T21:00:02.445362+0000","last_fullsized":"2024-05-08T21:00:02.445362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444671+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T21:00:02.444671+0000","last_peered":"2024-05-08T21:00:02.444671+0000","last_clean":"2024-05-08T21:00:02.444671+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:02.444671+0000","last_undegraded":"2024-05-08T21:00:02.444671+0000","last_fullsized":"2024-05-08T21:00:02.444671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":82,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442467+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T21:00:02.442467+0000","last_peered":"2024-05-08T21:00:02.442467+0000","last_clean":"2024-05-08T21:00:02.442467+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:02.442467+0000","last_undegraded":"2024-05-08T21:00:02.442467+0000","last_fullsized":"2024-05-08T21:00:02.442467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428747+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T21:00:02.428747+0000","last_peered":"2024-05-08T21:00:02.428747+0000","last_clean":"2024-05-08T21:00:02.428747+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:02.428747+0000","last_undegraded":"2024-05-08T21:00:02.428747+0000","last_fullsized":"2024-05-08T21:00:02.428747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1517","reported_seq":1531,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202034+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:59:50.202034+0000","last_peered":"2024-05-08T20:59:50.202034+0000","last_clean":"2024-05-08T20:59:50.202034+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:59:50.202034+0000","last_undegraded":"2024-05-08T20:59:50.202034+0000","last_fullsized":"2024-05-08T20:59:50.202034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439140+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T21:00:02.439140+0000","last_peered":"2024-05-08T21:00:02.439140+0000","last_clean":"2024-05-08T21:00:02.439140+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:02.439140+0000","last_undegraded":"2024-05-08T21:00:02.439140+0000","last_fullsized":"2024-05-08T21:00:02.439140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188425+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:59:50.188425+0000","last_peered":"2024-05-08T20:59:50.188425+0000","last_clean":"2024-05-08T20:59:50.188425+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:59:50.188425+0000","last_undegraded":"2024-05-08T20:59:50.188425+0000","last_fullsized":"2024-05-08T20:59:50.188425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.191949+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:59:50.191949+0000","last_peered":"2024-05-08T20:59:50.191949+0000","last_clean":"2024-05-08T20:59:50.191949+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:59:50.191949+0000","last_undegraded":"2024-05-08T20:59:50.191949+0000","last_fullsized":"2024-05-08T20:59:50.191949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437829+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T21:00:02.437829+0000","last_peered":"2024-05-08T21:00:02.437829+0000","last_clean":"2024-05-08T21:00:02.437829+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:00:02.437829+0000","last_undegraded":"2024-05-08T21:00:02.437829+0000","last_fullsized":"2024-05-08T21:00:02.437829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:59:50.201560+0000","last_peered":"2024-05-08T20:59:50.201560+0000","last_clean":"2024-05-08T20:59:50.201560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:59:50.201560+0000","last_undegraded":"2024-05-08T20:59:50.201560+0000","last_fullsized":"2024-05-08T20:59:50.201560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431503+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T21:00:02.431503+0000","last_peered":"2024-05-08T21:00:02.431503+0000","last_clean":"2024-05-08T21:00:02.431503+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:02.431503+0000","last_undegraded":"2024-05-08T21:00:02.431503+0000","last_fullsized":"2024-05-08T21:00:02.431503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188688+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:59:50.188688+0000","last_peered":"2024-05-08T20:59:50.188688+0000","last_clean":"2024-05-08T20:59:50.188688+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:59:50.188688+0000","last_undegraded":"2024-05-08T20:59:50.188688+0000","last_fullsized":"2024-05-08T20:59:50.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":86,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446668+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T21:00:02.446668+0000","last_peered":"2024-05-08T21:00:02.446668+0000","last_clean":"2024-05-08T21:00:02.446668+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:02.446668+0000","last_undegraded":"2024-05-08T21:00:02.446668+0000","last_fullsized":"2024-05-08T21:00:02.446668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201606+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:59:50.201606+0000","last_peered":"2024-05-08T20:59:50.201606+0000","last_clean":"2024-05-08T20:59:50.201606+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:59:50.201606+0000","last_undegraded":"2024-05-08T20:59:50.201606+0000","last_fullsized":"2024-05-08T20:59:50.201606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445301+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T21:00:02.445301+0000","last_peered":"2024-05-08T21:00:02.445301+0000","last_clean":"2024-05-08T21:00:02.445301+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:02.445301+0000","last_undegraded":"2024-05-08T21:00:02.445301+0000","last_fullsized":"2024-05-08T21:00:02.445301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:53:27.532142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.271646+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T21:00:00.271646+0000","last_peered":"2024-05-08T21:00:00.271646+0000","last_clean":"2024-05-08T21:00:00.271646+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:00.271646+0000","last_undegraded":"2024-05-08T21:00:00.271646+0000","last_fullsized":"2024-05-08T21:00:00.271646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444429+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T21:00:02.444429+0000","last_peered":"2024-05-08T21:00:02.444429+0000","last_clean":"2024-05-08T21:00:02.444429+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:02.444429+0000","last_undegraded":"2024-05-08T21:00:02.444429+0000","last_fullsized":"2024-05-08T21:00:02.444429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'912","reported_seq":926,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:55.140352+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:59:55.140352+0000","last_peered":"2024-05-08T20:59:55.140352+0000","last_clean":"2024-05-08T20:59:55.140352+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:59:55.140352+0000","last_undegraded":"2024-05-08T20:59:55.140352+0000","last_fullsized":"2024-05-08T20:59:55.140352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442866+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442866+0000","last_peered":"2024-05-08T21:00:02.442866+0000","last_clean":"2024-05-08T21:00:02.442866+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442866+0000","last_undegraded":"2024-05-08T21:00:02.442866+0000","last_fullsized":"2024-05-08T21:00:02.442866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'17","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192139+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:59:50.192139+0000","last_peered":"2024-05-08T20:59:50.192139+0000","last_clean":"2024-05-08T20:59:50.192139+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:59:50.192139+0000","last_undegraded":"2024-05-08T20:59:50.192139+0000","last_fullsized":"2024-05-08T20:59:50.192139+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443140+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T21:00:02.443140+0000","last_peered":"2024-05-08T21:00:02.443140+0000","last_clean":"2024-05-08T21:00:02.443140+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:02.443140+0000","last_undegraded":"2024-05-08T21:00:02.443140+0000","last_fullsized":"2024-05-08T21:00:02.443140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:54.089782+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:59:54.089782+0000","last_peered":"2024-05-08T20:59:54.089782+0000","last_clean":"2024-05-08T20:59:54.089782+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:59:54.089782+0000","last_undegraded":"2024-05-08T20:59:54.089782+0000","last_fullsized":"2024-05-08T20:59:54.089782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444142+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T21:00:02.444142+0000","last_peered":"2024-05-08T21:00:02.444142+0000","last_clean":"2024-05-08T21:00:02.444142+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:00:02.444142+0000","last_undegraded":"2024-05-08T21:00:02.444142+0000","last_fullsized":"2024-05-08T21:00:02.444142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.112953+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:59:56.112953+0000","last_peered":"2024-05-08T20:59:56.112953+0000","last_clean":"2024-05-08T20:59:56.112953+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:59:56.112953+0000","last_undegraded":"2024-05-08T20:59:56.112953+0000","last_fullsized":"2024-05-08T20:59:56.112953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437682+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T21:00:02.437682+0000","last_peered":"2024-05-08T21:00:02.437682+0000","last_clean":"2024-05-08T21:00:02.437682+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:02.437682+0000","last_undegraded":"2024-05-08T21:00:02.437682+0000","last_fullsized":"2024-05-08T21:00:02.437682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.146830+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:59:56.146830+0000","last_peered":"2024-05-08T20:59:56.146830+0000","last_clean":"2024-05-08T20:59:56.146830+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:59:56.146830+0000","last_undegraded":"2024-05-08T20:59:56.146830+0000","last_fullsized":"2024-05-08T20:59:56.146830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442900+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T21:00:02.442900+0000","last_peered":"2024-05-08T21:00:02.442900+0000","last_clean":"2024-05-08T21:00:02.442900+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.442900+0000","last_undegraded":"2024-05-08T21:00:02.442900+0000","last_fullsized":"2024-05-08T21:00:02.442900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194192+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:59:50.194192+0000","last_peered":"2024-05-08T20:59:50.194192+0000","last_clean":"2024-05-08T20:59:50.194192+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:59:50.194192+0000","last_undegraded":"2024-05-08T20:59:50.194192+0000","last_fullsized":"2024-05-08T20:59:50.194192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442829+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T21:00:02.442829+0000","last_peered":"2024-05-08T21:00:02.442829+0000","last_clean":"2024-05-08T21:00:02.442829+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:02.442829+0000","last_undegraded":"2024-05-08T21:00:02.442829+0000","last_fullsized":"2024-05-08T21:00:02.442829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202258+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:59:50.202258+0000","last_peered":"2024-05-08T20:59:50.202258+0000","last_clean":"2024-05-08T20:59:50.202258+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:59:50.202258+0000","last_undegraded":"2024-05-08T20:59:50.202258+0000","last_fullsized":"2024-05-08T20:59:50.202258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443122+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T21:00:02.443122+0000","last_peered":"2024-05-08T21:00:02.443122+0000","last_clean":"2024-05-08T21:00:02.443122+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:00:02.443122+0000","last_undegraded":"2024-05-08T21:00:02.443122+0000","last_fullsized":"2024-05-08T21:00:02.443122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.199275+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:59:50.199275+0000","last_peered":"2024-05-08T20:59:50.199275+0000","last_clean":"2024-05-08T20:59:50.199275+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:59:50.199275+0000","last_undegraded":"2024-05-08T20:59:50.199275+0000","last_fullsized":"2024-05-08T20:59:50.199275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441899+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T21:00:02.441899+0000","last_peered":"2024-05-08T21:00:02.441899+0000","last_clean":"2024-05-08T21:00:02.441899+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:02.441899+0000","last_undegraded":"2024-05-08T21:00:02.441899+0000","last_fullsized":"2024-05-08T21:00:02.441899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196209+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:59:50.196209+0000","last_peered":"2024-05-08T20:59:50.196209+0000","last_clean":"2024-05-08T20:59:50.196209+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:59:50.196209+0000","last_undegraded":"2024-05-08T20:59:50.196209+0000","last_fullsized":"2024-05-08T20:59:50.196209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442928+0000","last_change":"2024-05-08T20:57:23.939637+0000","last_active":"2024-05-08T21:00:02.442928+0000","last_peered":"2024-05-08T21:00:02.442928+0000","last_clean":"2024-05-08T21:00:02.442928+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:00:02.442928+0000","last_undegraded":"2024-05-08T21:00:02.442928+0000","last_fullsized":"2024-05-08T21:00:02.442928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:34.651453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:57:23.936478+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:57:23.936478+0000","last_peered":"2024-05-08T20:57:23.936478+0000","last_clean":"2024-05-08T20:57:23.936478+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:57:23.936478+0000","last_undegraded":"2024-05-08T20:57:23.936478+0000","last_fullsized":"2024-05-08T20:57:23.936478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196651+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:59:50.196651+0000","last_peered":"2024-05-08T20:59:50.196651+0000","last_clean":"2024-05-08T20:59:50.196651+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:59:50.196651+0000","last_undegraded":"2024-05-08T20:59:50.196651+0000","last_fullsized":"2024-05-08T20:59:50.196651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445409+0000","last_change":"2024-05-08T20:57:23.937184+0000","last_active":"2024-05-08T21:00:02.445409+0000","last_peered":"2024-05-08T21:00:02.445409+0000","last_clean":"2024-05-08T21:00:02.445409+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:02.445409+0000","last_undegraded":"2024-05-08T21:00:02.445409+0000","last_fullsized":"2024-05-08T21:00:02.445409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:09.178871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206244+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:59:50.206244+0000","last_peered":"2024-05-08T20:59:50.206244+0000","last_clean":"2024-05-08T20:59:50.206244+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:59:50.206244+0000","last_undegraded":"2024-05-08T20:59:50.206244+0000","last_fullsized":"2024-05-08T20:59:50.206244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437533+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T21:00:02.437533+0000","last_peered":"2024-05-08T21:00:02.437533+0000","last_clean":"2024-05-08T21:00:02.437533+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:02.437533+0000","last_undegraded":"2024-05-08T21:00:02.437533+0000","last_fullsized":"2024-05-08T21:00:02.437533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'73","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.174851+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T21:00:01.174851+0000","last_peered":"2024-05-08T21:00:01.174851+0000","last_clean":"2024-05-08T21:00:01.174851+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:01.174851+0000","last_undegraded":"2024-05-08T21:00:01.174851+0000","last_fullsized":"2024-05-08T21:00:01.174851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428782+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T21:00:02.428782+0000","last_peered":"2024-05-08T21:00:02.428782+0000","last_clean":"2024-05-08T21:00:02.428782+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:00:02.428782+0000","last_undegraded":"2024-05-08T21:00:02.428782+0000","last_fullsized":"2024-05-08T21:00:02.428782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206180+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:59:50.206180+0000","last_peered":"2024-05-08T20:59:50.206180+0000","last_clean":"2024-05-08T20:59:50.206180+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:59:50.206180+0000","last_undegraded":"2024-05-08T20:59:50.206180+0000","last_fullsized":"2024-05-08T20:59:50.206180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439343+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T21:00:02.439343+0000","last_peered":"2024-05-08T21:00:02.439343+0000","last_clean":"2024-05-08T21:00:02.439343+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:02.439343+0000","last_undegraded":"2024-05-08T21:00:02.439343+0000","last_fullsized":"2024-05-08T21:00:02.439343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.193955+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:59:50.193955+0000","last_peered":"2024-05-08T20:59:50.193955+0000","last_clean":"2024-05-08T20:59:50.193955+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:59:50.193955+0000","last_undegraded":"2024-05-08T20:59:50.193955+0000","last_fullsized":"2024-05-08T20:59:50.193955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441988+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T21:00:02.441988+0000","last_peered":"2024-05-08T21:00:02.441988+0000","last_clean":"2024-05-08T21:00:02.441988+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:02.441988+0000","last_undegraded":"2024-05-08T21:00:02.441988+0000","last_fullsized":"2024-05-08T21:00:02.441988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202542+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:59:50.202542+0000","last_peered":"2024-05-08T20:59:50.202542+0000","last_clean":"2024-05-08T20:59:50.202542+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:59:50.202542+0000","last_undegraded":"2024-05-08T20:59:50.202542+0000","last_fullsized":"2024-05-08T20:59:50.202542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428981+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T21:00:02.428981+0000","last_peered":"2024-05-08T21:00:02.428981+0000","last_clean":"2024-05-08T21:00:02.428981+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:02.428981+0000","last_undegraded":"2024-05-08T21:00:02.428981+0000","last_fullsized":"2024-05-08T21:00:02.428981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'40","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.379978+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T21:00:00.379978+0000","last_peered":"2024-05-08T21:00:00.379978+0000","last_clean":"2024-05-08T21:00:00.379978+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:00.379978+0000","last_undegraded":"2024-05-08T21:00:00.379978+0000","last_fullsized":"2024-05-08T21:00:00.379978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444857+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T21:00:02.444857+0000","last_peered":"2024-05-08T21:00:02.444857+0000","last_clean":"2024-05-08T21:00:02.444857+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:02.444857+0000","last_undegraded":"2024-05-08T21:00:02.444857+0000","last_fullsized":"2024-05-08T21:00:02.444857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'26","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.178249+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T21:00:01.178249+0000","last_peered":"2024-05-08T21:00:01.178249+0000","last_clean":"2024-05-08T21:00:01.178249+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:01.178249+0000","last_undegraded":"2024-05-08T21:00:01.178249+0000","last_fullsized":"2024-05-08T21:00:01.178249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433907+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T21:00:02.433907+0000","last_peered":"2024-05-08T21:00:02.433907+0000","last_clean":"2024-05-08T21:00:02.433907+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:02.433907+0000","last_undegraded":"2024-05-08T21:00:02.433907+0000","last_fullsized":"2024-05-08T21:00:02.433907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202507+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:59:50.202507+0000","last_peered":"2024-05-08T20:59:50.202507+0000","last_clean":"2024-05-08T20:59:50.202507+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:59:50.202507+0000","last_undegraded":"2024-05-08T20:59:50.202507+0000","last_fullsized":"2024-05-08T20:59:50.202507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.420471+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T21:00:02.420471+0000","last_peered":"2024-05-08T21:00:02.420471+0000","last_clean":"2024-05-08T21:00:02.420471+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:02.420471+0000","last_undegraded":"2024-05-08T21:00:02.420471+0000","last_fullsized":"2024-05-08T21:00:02.420471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:58.293039+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T20:59:58.293039+0000","last_peered":"2024-05-08T20:59:58.293039+0000","last_clean":"2024-05-08T20:59:58.293039+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T20:59:58.293039+0000","last_undegraded":"2024-05-08T20:59:58.293039+0000","last_fullsized":"2024-05-08T20:59:58.293039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.430991+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T21:00:02.430991+0000","last_peered":"2024-05-08T21:00:02.430991+0000","last_clean":"2024-05-08T21:00:02.430991+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:00:02.430991+0000","last_undegraded":"2024-05-08T21:00:02.430991+0000","last_fullsized":"2024-05-08T21:00:02.430991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.193817+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:59:50.193817+0000","last_peered":"2024-05-08T20:59:50.193817+0000","last_clean":"2024-05-08T20:59:50.193817+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:59:50.193817+0000","last_undegraded":"2024-05-08T20:59:50.193817+0000","last_fullsized":"2024-05-08T20:59:50.193817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438822+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T21:00:02.438822+0000","last_peered":"2024-05-08T21:00:02.438822+0000","last_clean":"2024-05-08T21:00:02.438822+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:02.438822+0000","last_undegraded":"2024-05-08T21:00:02.438822+0000","last_fullsized":"2024-05-08T21:00:02.438822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'518","reported_seq":532,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.203240+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:59:50.203240+0000","last_peered":"2024-05-08T20:59:50.203240+0000","last_clean":"2024-05-08T20:59:50.203240+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:59:50.203240+0000","last_undegraded":"2024-05-08T20:59:50.203240+0000","last_fullsized":"2024-05-08T20:59:50.203240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431702+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T21:00:02.431702+0000","last_peered":"2024-05-08T21:00:02.431702+0000","last_clean":"2024-05-08T21:00:02.431702+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:02.431702+0000","last_undegraded":"2024-05-08T21:00:02.431702+0000","last_fullsized":"2024-05-08T21:00:02.431702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444036+0000","last_change":"2024-05-08T20:57:23.945794+0000","last_active":"2024-05-08T21:00:02.444036+0000","last_peered":"2024-05-08T21:00:02.444036+0000","last_clean":"2024-05-08T21:00:02.444036+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:02.444036+0000","last_undegraded":"2024-05-08T21:00:02.444036+0000","last_fullsized":"2024-05-08T21:00:02.444036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:33.164158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192833+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:59:50.192833+0000","last_peered":"2024-05-08T20:59:50.192833+0000","last_clean":"2024-05-08T20:59:50.192833+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:59:50.192833+0000","last_undegraded":"2024-05-08T20:59:50.192833+0000","last_fullsized":"2024-05-08T20:59:50.192833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429835+0000","last_change":"2024-05-08T20:57:23.945132+0000","last_active":"2024-05-08T21:00:02.429835+0000","last_peered":"2024-05-08T21:00:02.429835+0000","last_clean":"2024-05-08T21:00:02.429835+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:02.429835+0000","last_undegraded":"2024-05-08T21:00:02.429835+0000","last_fullsized":"2024-05-08T21:00:02.429835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:56.195391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:11.915454+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T21:00:11.915454+0000","last_peered":"2024-05-08T21:00:11.915454+0000","last_clean":"2024-05-08T21:00:11.915454+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:11.915454+0000","last_undegraded":"2024-05-08T21:00:11.915454+0000","last_fullsized":"2024-05-08T21:00:11.915454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566303,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445227+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T21:00:02.445227+0000","last_peered":"2024-05-08T21:00:02.445227+0000","last_clean":"2024-05-08T21:00:02.445227+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:02.445227+0000","last_undegraded":"2024-05-08T21:00:02.445227+0000","last_fullsized":"2024-05-08T21:00:02.445227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:53.768715+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:59:53.768715+0000","last_peered":"2024-05-08T20:59:53.768715+0000","last_clean":"2024-05-08T20:59:53.768715+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:59:53.768715+0000","last_undegraded":"2024-05-08T20:59:53.768715+0000","last_fullsized":"2024-05-08T20:59:53.768715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T21:00:02.439978+0000","last_peered":"2024-05-08T21:00:02.439978+0000","last_clean":"2024-05-08T21:00:02.439978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:02.439978+0000","last_undegraded":"2024-05-08T21:00:02.439978+0000","last_fullsized":"2024-05-08T21:00:02.439978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194983+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:59:50.194983+0000","last_peered":"2024-05-08T20:59:50.194983+0000","last_clean":"2024-05-08T20:59:50.194983+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:59:50.194983+0000","last_undegraded":"2024-05-08T20:59:50.194983+0000","last_fullsized":"2024-05-08T20:59:50.194983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090733,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3113,"num_write_kb":31561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3820,"ondisk_log_size":3820,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77900000000000003,"15min":0.80800000000000005},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95399999999999996,"5min":1.22,"15min":1.22},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":1.254,"15min":1.254},"last":0.64400000000000002}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91300000000000003,"15min":0.93500000000000005},"min":{"1min":0.59899999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.236,"5min":1.298,"15min":1.298},"last":1.105},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.99399999999999999},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.0409999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93100000000000005,"15min":0.97399999999999998},"min":{"1min":0.63,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1850000000000001,"5min":1.274,"15min":1.274},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1,"15min":1.042},"min":{"1min":0.73199999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3120000000000001,"5min":1.399,"15min":1.399},"last":0.97099999999999997}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.86699999999999999,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.042,"15min":1.0960000000000001},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1919999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3819999999999999,"5min":1.397,"15min":1.397},"last":0.997}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0680000000000001,"15min":1.095},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1519999999999999,"5min":1.425,"15min":1.425},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.046,"5min":1.121,"15min":1.1439999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5169999999999999,"5min":1.734,"15min":1.734},"last":1.075}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1519999999999999,"15min":1.1779999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.583,"5min":1.821,"15min":1.821},"last":1.179},{"interface":"front","average":{"1min":1.145,"5min":1.173,"15min":1.2010000000000001},"min":{"1min":0.84499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.202}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14038940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.88900000000000001,"15min":0.93100000000000005},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2150000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.343},"last":0.95399999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95399999999999996,"15min":0.997},"min":{"1min":0.58899999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.26,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0269999999999999},"min":{"1min":0.75900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.198,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.0580000000000001}]},{"osd":2,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.57899999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.626,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1100000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.84899999999999998}]},{"osd":3,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.58999999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.88600000000000001}]},{"osd":4,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.153,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0209999999999999,"15min":1.046},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2290000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.109}]},{"osd":5,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96299999999999997,"15min":0.96999999999999997},"min":{"1min":0.63,"5min":0.62,"15min":0.62},"max":{"1min":1.198,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.077,"15min":1.089},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3640000000000001,"5min":1.403,"15min":1.403},"last":1.0289999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1200000000000001,"15min":1.1419999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.369,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1060000000000001,"15min":1.119},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.3400000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.0820000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.58099999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0600000000000001,"5min":1.173,"15min":1.173},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81799999999999995,"15min":0.81899999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.159,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53100000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"min":{"1min":0.55700000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.82699999999999996}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.59099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.226,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0509999999999999,"5min":1.401,"15min":1.401},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93100000000000005,"15min":0.95799999999999996},"min":{"1min":0.65500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.075,"5min":1.256,"15min":1.256},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.73699999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2150000000000001,"5min":1.341,"15min":1.341},"last":0.91200000000000003}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.129,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.004},"min":{"1min":0.75800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.224,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0669999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.052,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3320000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.071,"15min":1.0860000000000001},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.1859999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.083,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4650000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.145}]}]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80200000000000005,"15min":0.82799999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0920000000000001,"5min":1.139,"15min":1.139},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.93300000000000005},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.077,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2210000000000001,"5min":1.292,"15min":1.292},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.127,"5min":1.556,"15min":1.556},"last":1}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85899999999999999,"15min":0.89400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.079,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95799999999999996}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.169,"5min":1.613,"15min":1.613},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97899999999999998,"15min":1.0049999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.208,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":0.91800000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1200000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0640000000000001,"15min":1.0900000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.78,"15min":1.78},"last":1.2030000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.014,"15min":1.052},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.998,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.333,"5min":1.784,"15min":1.784},"last":1.2529999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3089999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.089},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1279999999999999,"15min":1.155},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4410000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.66500000000000004},"min":{"1min":0.51400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.048,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.63},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.88700000000000001}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.71499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.075,"15min":1.075},"last":0.81899999999999995}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74299999999999999,"15min":0.753},"min":{"1min":0.621,"5min":0.308,"15min":0.308},"max":{"1min":1.236,"5min":1.671,"15min":1.671},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.58199999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.302},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.002,"15min":1.02},"min":{"1min":0.69599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4950000000000001,"5min":1.522,"15min":1.522},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.071,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.72999999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.407,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.85799999999999998}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0229999999999999,"15min":1.0289999999999999},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.994,"15min":1.994},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.117,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.878,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.444,"5min":2.198,"15min":2.198},"last":1.038}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.85899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4850000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1140000000000001,"15min":1.1240000000000001},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.0109999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1379999999999999,"15min":1.173},"min":{"1min":0.91900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.492,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.097},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.167},"min":{"1min":0.92200000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.403,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.55100000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.101,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.081,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67100000000000004,"15min":0.68999999999999995},"min":{"1min":0.35399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.56799999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.83599999999999997}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.78000000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.4510000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97999999999999998,"15min":1},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.349,"5min":1.577,"15min":1.577},"last":0.86299999999999999}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.054},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.71899999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.49,"5min":1.8,"15min":1.8},"last":1.1759999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.016,"15min":1.0409999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4379999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.054,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3149999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.026,"15min":1.042},"min":{"1min":0.71899999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.087,"15min":1.1459999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.254,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.147}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.872,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1279999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.63200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.67400000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.67700000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":1.014},"min":{"1min":0.77700000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.341,"5min":1.901,"15min":1.901},"last":0.88100000000000001}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0569999999999999,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.298,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.034,"15min":1.04},"min":{"1min":0.84799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.2170000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0640000000000001,"15min":1.0920000000000001},"min":{"1min":0.90500000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.105,"15min":1.1399999999999999},"min":{"1min":0.92000000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.371,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.1200000000000001}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.90000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.149},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.115,"15min":1.143},"min":{"1min":0.96499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6180000000000001,"5min":2.02,"15min":2.02},"last":0.92200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.317,"5min":0.251,"15min":0.251},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.754},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2989999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.82399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96199999999999997,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.92200000000000004,"15min":0.99299999999999999},"min":{"1min":0.40400000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.153,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.80500000000000005}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92600000000000005,"15min":0.92200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.94799999999999995}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.077,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.64800000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.083}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0009999999999999,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.034},{"interface":"front","average":{"1min":1.038,"5min":1.212,"15min":1.327},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.526,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":1.006}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.022,"15min":1.0449999999999999},"min":{"1min":0.67600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.278,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.0569999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:00:26.348 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:00:26.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.456+0000 7fd0508ca700 1 Processor -- start 2024-05-08T21:00:26.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.456+0000 7fd0508ca700 1 -- start start 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd04c0ce510 0x7fd04c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c15aaa0 0x7fd04c13d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c0ce080 con 0x7fd04c071ab0 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0cd7c0 con 0x7fd04c0ce510 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0cda30 con 0x7fd04c15aaa0 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd04c0ce510 0x7fd04c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd04c0ce510 0x7fd04c15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36160/0 (socket says 172.21.15.107:36160) 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 -- 172.21.15.107:0/2318836429 learned_addr learned my addr 172.21.15.107:0/2318836429 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:26.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04b59e700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c15aaa0 0x7fd04c13d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 -- 172.21.15.107:0/2318836429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c15aaa0 msgr2=0x7fd04c13d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c15aaa0 0x7fd04c13d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 -- 172.21.15.107:0/2318836429 >> v1:172.21.15.107:6789/0 conn(0x7fd04c071ab0 legacy=0x7fd04c071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 -- 172.21.15.107:0/2318836429 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0cdd10 con 0x7fd04c0ce510 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04b59e700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c15aaa0 0x7fd04c13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd04a59c700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c0ce510 0x7fd04c15a560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd03400bbb0 tx=0x7fd03400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61b01e495c9d53f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd049d9b700 1 -- 172.21.15.107:0/2318836429 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400dd90 con 0x7fd04c0ce510 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd049d9b700 1 -- 172.21.15.107:0/2318836429 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034010470 con 0x7fd04c0ce510 2024-05-08T21:00:26.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd049d9b700 1 -- 172.21.15.107:0/2318836429 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034010820 con 0x7fd04c0ce510 2024-05-08T21:00:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- 172.21.15.107:0/2318836429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c0ce510 msgr2=0x7fd04c15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c0ce510 0x7fd04c15a560 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd03400bbb0 tx=0x7fd03400bec0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- 172.21.15.107:0/2318836429 shutdown_connections 2024-05-08T21:00:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c15aaa0 0x7fd04c13d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 --2- 172.21.15.107:0/2318836429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c0ce510 0x7fd04c15a560 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- 172.21.15.107:0/2318836429 >> 172.21.15.107:0/2318836429 conn(0x7fd04c06c330 msgr2=0x7fd04c06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:26.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- 172.21.15.107:0/2318836429 shutdown_connections 2024-05-08T21:00:26.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.460+0000 7fd0508ca700 1 -- 172.21.15.107:0/2318836429 wait complete. 2024-05-08T21:00:26.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 Processor -- start 2024-05-08T21:00:26.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 -- start start 2024-05-08T21:00:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c071ab0 0x7fd04c156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd04c0ce510 0x7fd04c136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 0x7fd04c139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c1554a0 con 0x7fd04c15aaa0 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c155780 con 0x7fd04c0ce510 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd0508ca700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c155a60 con 0x7fd04c071ab0 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 0x7fd04c139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 0x7fd04c139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36170/0 (socket says 172.21.15.107:36170) 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 -- 172.21.15.107:0/198483879 learned_addr learned my addr 172.21.15.107:0/198483879 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04a59c700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd04c0ce510 0x7fd04c136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04ad9d700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c071ab0 0x7fd04c156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 -- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c071ab0 msgr2=0x7fd04c156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c071ab0 0x7fd04c156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 -- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd04c0ce510 msgr2=0x7fd04c136ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd04c0ce510 0x7fd04c136ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04b59e700 1 -- 172.21.15.107:0/198483879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03400b810 con 0x7fd04c15aaa0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.464+0000 7fd04ad9d700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c071ab0 0x7fd04c156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd04b59e700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 0x7fd04c139120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00e810 tx=0x7fd03c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c004220 con 0x7fd04c15aaa0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c0043a0 con 0x7fd04c15aaa0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c0036c0 con 0x7fd04c15aaa0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c155d40 con 0x7fd04c15aaa0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c156300 con 0x7fd04c15aaa0 2024-05-08T21:00:26.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c1564f0 con 0x7fd04c15aaa0 2024-05-08T21:00:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd03c003820 con 0x7fd04c15aaa0 2024-05-08T21:00:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0437fe700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd02c066760 0x7fd02c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd04ad9d700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd02c066760 0x7fd02c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:26.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.468+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fd03c083b60 con 0x7fd04c15aaa0 2024-05-08T21:00:26.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.472+0000 7fd04ad9d700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd02c066760 0x7fd02c068c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd0440021f0 tx=0x7fd044009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:26.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.476+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd03c050cd0 con 0x7fd04c15aaa0 2024-05-08T21:00:26.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.648+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd04c0684b0 con 0x7fd04c15aaa0 2024-05-08T21:00:26.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0437fe700 1 -- 172.21.15.107:0/198483879 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7fd03c020020 con 0x7fd04c15aaa0 2024-05-08T21:00:26.659 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:26.660 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd02c066760 msgr2=0x7fd02c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd02c066760 0x7fd02c068c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd0440021f0 tx=0x7fd044009040 comp rx=0 tx=0).stop 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 msgr2=0x7fd04c139120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 0x7fd04c139120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd03c00e810 tx=0x7fd03c00eb20 comp rx=0 tx=0).stop 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 shutdown_connections 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd04c15aaa0 0x7fd04c139120 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd04c0ce510 0x7fd04c136ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd02c066760 0x7fd02c068c20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 --2- 172.21.15.107:0/198483879 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd04c071ab0 0x7fd04c156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 >> 172.21.15.107:0/198483879 conn(0x7fd04c06c330 msgr2=0x7fd04c13adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:26.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 shutdown_connections 2024-05-08T21:00:26.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:26.652+0000 7fd0508ca700 1 -- 172.21.15.107:0/198483879 wait complete. 2024-05-08T21:00:27.676 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T21:00:27.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.800+0000 7f4ac889b700 1 Processor -- start 2024-05-08T21:00:27.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.800+0000 7f4ac889b700 1 -- start start 2024-05-08T21:00:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ac406cf20 0x7f4ac415af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40cde80 con 0x7f4ac40ceae0 2024-05-08T21:00:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac415e190 con 0x7f4ac40ce700 2024-05-08T21:00:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac415ea30 con 0x7f4ac406cf20 2024-05-08T21:00:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac2ffd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4ac40ceae0 0x7f4ac406c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37276/0 (socket says 172.21.15.107:37276) 2024-05-08T21:00:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac3fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4ac406cf20 0x7f4ac415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac2ffd700 1 -- 172.21.15.107:0/344533657 learned_addr learned my addr 172.21.15.107:0/344533657 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:27.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac27fc700 1 -- 172.21.15.107:0/344533657 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340334010 0 0) 0x7f4ac40cde80 con 0x7f4ac40ceae0 2024-05-08T21:00:27.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac27fc700 1 -- 172.21.15.107:0/344533657 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac0035d0 con 0x7f4ac40ceae0 2024-05-08T21:00:27.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac3fff700 1 -- 172.21.15.107:0/344533657 >> v1:172.21.15.195:6789/0 conn(0x7f4ac40ce700 legacy=0x7f4ac40cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac3fff700 1 -- 172.21.15.107:0/344533657 >> v1:172.21.15.107:6789/0 conn(0x7f4ac40ceae0 legacy=0x7f4ac406c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac3fff700 1 -- 172.21.15.107:0/344533657 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac415e470 con 0x7f4ac406cf20 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac3fff700 1 --2- 172.21.15.107:0/344533657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac406cf20 0x7f4ac415af40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009d90 tx=0x7f4abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383f52aaa99c236d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac27fc700 1 -- 172.21.15.107:0/344533657 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00e070 con 0x7f4ac406cf20 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac27fc700 1 -- 172.21.15.107:0/344533657 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc00bb20 con 0x7f4ac406cf20 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac27fc700 1 -- 172.21.15.107:0/344533657 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc012430 con 0x7f4ac406cf20 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- 172.21.15.107:0/344533657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac406cf20 msgr2=0x7f4ac415af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 --2- 172.21.15.107:0/344533657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac406cf20 0x7f4ac415af40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009d90 tx=0x7f4abc00b330 comp rx=0 tx=0).stop 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- 172.21.15.107:0/344533657 shutdown_connections 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 --2- 172.21.15.107:0/344533657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac406cf20 0x7f4ac415af40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- 172.21.15.107:0/344533657 >> 172.21.15.107:0/344533657 conn(0x7f4ac406d650 msgr2=0x7f4ac406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- 172.21.15.107:0/344533657 shutdown_connections 2024-05-08T21:00:27.814 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- 172.21.15.107:0/344533657 wait complete. 2024-05-08T21:00:27.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 Processor -- start 2024-05-08T21:00:27.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.804+0000 7f4ac889b700 1 -- start start 2024-05-08T21:00:27.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac406cf20 0x7f4ac4152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac40ce700 0x7f4ac4154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40ceae0 0x7f4ac4146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41526b0 con 0x7f4ac40ce700 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41463e0 con 0x7f4ac40ceae0 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4151a30 con 0x7f4ac406cf20 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac40ce700 0x7f4ac4154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac40ce700 0x7f4ac4154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36182/0 (socket says 172.21.15.107:36182) 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 -- 172.21.15.107:0/2992104903 learned_addr learned my addr 172.21.15.107:0/2992104903 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac37fe700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac406cf20 0x7f4ac4152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac3fff700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40ceae0 0x7f4ac4146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 -- 172.21.15.107:0/2992104903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac406cf20 msgr2=0x7f4ac4152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4ac406cf20 0x7f4ac4152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 -- 172.21.15.107:0/2992104903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40ceae0 msgr2=0x7f4ac4146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ac40ceae0 0x7f4ac4146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 -- 172.21.15.107:0/2992104903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc009a70 con 0x7f4ac40ce700 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac2ffd700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac40ce700 0x7f4ac4154490 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c500 tx=0x7f4ab800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8005d90 con 0x7f4ac40ce700 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80070d0 con 0x7f4ac40ce700 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4151d10 con 0x7f4ac40ce700 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8007480 con 0x7f4ac40ce700 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.808+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac41522d0 con 0x7f4ac40ce700 2024-05-08T21:00:27.819 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ac40b2740 con 0x7f4ac40ce700 2024-05-08T21:00:27.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ab80075e0 con 0x7f4ac40ce700 2024-05-08T21:00:27.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4aabfff700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4ab0066730 0x7f4ab0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f4ab8083600 con 0x7f4ac40ce700 2024-05-08T21:00:27.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4ac37fe700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4ab0066730 0x7f4ab0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4aabfff700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f4ab006ebb0 0x7f4ab0071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 --> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ab0071720 con 0x7f4ab006ebb0 2024-05-08T21:00:27.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ab8085be0 con 0x7f4ac40ce700 2024-05-08T21:00:27.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4ac3fff700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f4ab006ebb0 0x7f4ab0071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4ac37fe700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4ab0066730 0x7f4ab0068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000f60 tx=0x7f4ab4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.812+0000 7f4ac3fff700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f4ab006ebb0 0x7f4ab0071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.816+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== osd.0 v2:172.21.15.107:6824/26126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4ab0071720 con 0x7f4ab006ebb0 2024-05-08T21:00:27.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 --> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ac41527f0 con 0x7f4ab006ebb0 2024-05-08T21:00:27.841 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4aabfff700 1 -- 172.21.15.107:0/2992104903 <== osd.0 v2:172.21.15.107:6824/26126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4ac41527f0 con 0x7f4ab006ebb0 2024-05-08T21:00:27.841 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:27.841 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:27.841 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:27.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f4ab006ebb0 msgr2=0x7f4ab0071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6824/26126,v1:172.21.15.107:6825/26126] conn(0x7f4ab006ebb0 0x7f4ab0071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.842 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4ab0066730 msgr2=0x7f4ab0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4ab0066730 0x7f4ab0068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000f60 tx=0x7f4ab4009040 comp rx=0 tx=0).stop 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac40ce700 msgr2=0x7f4ac4154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 --2- 172.21.15.107:0/2992104903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ac40ce700 0x7f4ac4154490 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c500 tx=0x7f4ab800c810 comp rx=0 tx=0).stop 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac3fff700 1 -- 172.21.15.107:0/2992104903 reap_dead start 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 shutdown_connections 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 >> 172.21.15.107:0/2992104903 conn(0x7f4ac406d650 msgr2=0x7f4ac415cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 shutdown_connections 2024-05-08T21:00:27.843 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.832+0000 7f4ac889b700 1 -- 172.21.15.107:0/2992104903 wait complete. 2024-05-08T21:00:27.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T21:00:27.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.964+0000 7f7963fff700 1 Processor -- start 2024-05-08T21:00:27.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.964+0000 7f7963fff700 1 -- start start 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79640b3e40 0x7f796406b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f79640cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796415d1b0 con 0x7f7964153e40 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79640ccf50 con 0x7f79640b3e40 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796406bd20 con 0x7f796406b8b0 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7962ffd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7964153e40 0x7f79640b4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37284/0 (socket says 172.21.15.107:37284) 2024-05-08T21:00:27.977 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f795bfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79640b3e40 0x7f796406b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7962ffd700 1 -- 172.21.15.107:0/809101011 learned_addr learned my addr 172.21.15.107:0/809101011 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f79637fe700 1 --2- 172.21.15.107:0/809101011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f79640cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f795bfff700 1 -- 172.21.15.107:0/809101011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 msgr2=0x7f79640cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f795bfff700 1 --2- 172.21.15.107:0/809101011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f79640cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f795bfff700 1 -- 172.21.15.107:0/809101011 >> v1:172.21.15.107:6789/0 conn(0x7f7964153e40 legacy=0x7f79640b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f795bfff700 1 -- 172.21.15.107:0/809101011 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796415d450 con 0x7f79640b3e40 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f795bfff700 1 --2- 172.21.15.107:0/809101011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79640b3e40 0x7f796406b370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f794c009850 tx=0x7f794c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9ed675f9abd0d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f79627fc700 1 -- 172.21.15.107:0/809101011 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00f8a0 con 0x7f79640b3e40 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f79627fc700 1 -- 172.21.15.107:0/809101011 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00fa00 con 0x7f79640b3e40 2024-05-08T21:00:27.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f79627fc700 1 -- 172.21.15.107:0/809101011 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00fdb0 con 0x7f79640b3e40 2024-05-08T21:00:27.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- 172.21.15.107:0/809101011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79640b3e40 msgr2=0x7f796406b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 --2- 172.21.15.107:0/809101011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79640b3e40 0x7f796406b370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f794c009850 tx=0x7f794c009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:27.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- 172.21.15.107:0/809101011 shutdown_connections 2024-05-08T21:00:27.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 --2- 172.21.15.107:0/809101011 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f79640cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 --2- 172.21.15.107:0/809101011 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79640b3e40 0x7f796406b370 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- 172.21.15.107:0/809101011 >> 172.21.15.107:0/809101011 conn(0x7f7964070960 msgr2=0x7f7964070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:27.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- 172.21.15.107:0/809101011 shutdown_connections 2024-05-08T21:00:27.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.968+0000 7f7963fff700 1 -- 172.21.15.107:0/809101011 wait complete. 2024-05-08T21:00:27.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.972+0000 7f7963fff700 1 Processor -- start 2024-05-08T21:00:27.981 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.972+0000 7f7963fff700 1 -- start start 2024-05-08T21:00:27.984 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f7964154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79640b3e40 0x7f79641f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 0x7f79641ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7964147c80 con 0x7f7964153e40 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796412f890 con 0x7f79640b3e40 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7964147650 con 0x7f796406b8b0 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 0x7f79641ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 0x7f79641ee070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36208/0 (socket says 172.21.15.107:36208) 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 -- 172.21.15.107:0/2059698423 learned_addr learned my addr 172.21.15.107:0/2059698423 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f795bfff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79640b3e40 0x7f79641f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7962ffd700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f7964154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 -- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 msgr2=0x7f7964154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f7964154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 -- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79640b3e40 msgr2=0x7f79641f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79640b3e40 0x7f79641f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 -- 172.21.15.107:0/2059698423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0094b0 con 0x7f7964153e40 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f79637fe700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 0x7f79641ee070 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f795c008f70 tx=0x7f795c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00ac20 con 0x7f7964153e40 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c010040 con 0x7f7964153e40 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7964156d60 con 0x7f7964153e40 2024-05-08T21:00:27.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c014410 con 0x7f7964153e40 2024-05-08T21:00:27.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7964147910 con 0x7f7964153e40 2024-05-08T21:00:27.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.976+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7964147df0 con 0x7f7964153e40 2024-05-08T21:00:27.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.980+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f795c014570 con 0x7f7964153e40 2024-05-08T21:00:27.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.980+0000 7f795b7fe700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7944066730 0x7f7944068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:27.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.980+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f795c0848a0 con 0x7f7964153e40 2024-05-08T21:00:27.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.980+0000 7f7962ffd700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7944066730 0x7f7944068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:27.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.980+0000 7f7962ffd700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7944066730 0x7f7944068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7954005930 tx=0x7f7954009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:27.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:27.988+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f795c051aa0 con 0x7f7964153e40 2024-05-08T21:00:28.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.160+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f796415dcf0 con 0x7f7944066730 2024-05-08T21:00:28.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.160+0000 7f795b7fe700 1 -- 172.21.15.107:0/2059698423 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7954001d00 con 0x7f7944066730 2024-05-08T21:00:28.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7944066730 msgr2=0x7f7944068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7944066730 0x7f7944068bf0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7954005930 tx=0x7f7954009040 comp rx=0 tx=0).stop 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 msgr2=0x7f79641ee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 0x7f79641ee070 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f795c008f70 tx=0x7f795c007320 comp rx=0 tx=0).stop 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 shutdown_connections 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7964153e40 0x7f79641ee070 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f79640b3e40 0x7f79641f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7944066730 0x7f7944068bf0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 --2- 172.21.15.107:0/2059698423 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f796406b8b0 0x7f7964154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 >> 172.21.15.107:0/2059698423 conn(0x7f7964070960 msgr2=0x7f79640ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 shutdown_connections 2024-05-08T21:00:28.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.164+0000 7f7963fff700 1 -- 172.21.15.107:0/2059698423 wait complete. 2024-05-08T21:00:28.173 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T21:00:28.184 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T21:00:28.184 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:28.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 Processor -- start 2024-05-08T21:00:28.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- start start 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f96a015bd80 0x7f96a0165170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f96a006cf20 0x7f96a00b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a00b24e0 con 0x7f96a01656b0 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a0166180 con 0x7f96a006cf20 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a0165bc0 con 0x7f96a015bd80 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f96a006cf20 0x7f96a00b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f96a006cf20 0x7f96a00b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36224/0 (socket says 172.21.15.107:36224) 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 -- 172.21.15.107:0/662031840 learned_addr learned my addr 172.21.15.107:0/662031840 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f969ffff700 1 --2- 172.21.15.107:0/662031840 >> v2:172.21.15.195:3300/0 conn(0x7f96a015bd80 0x7f96a0165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 -- 172.21.15.107:0/662031840 >> v2:172.21.15.195:3300/0 conn(0x7f96a015bd80 msgr2=0x7f96a0165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 --2- 172.21.15.107:0/662031840 >> v2:172.21.15.195:3300/0 conn(0x7f96a015bd80 0x7f96a0165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 -- 172.21.15.107:0/662031840 >> v1:172.21.15.195:6789/0 conn(0x7f96a01656b0 legacy=0x7f96a006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 -- 172.21.15.107:0/662031840 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0165ea0 con 0x7f96a006cf20 2024-05-08T21:00:28.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a4c61700 1 --2- 172.21.15.107:0/662031840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a00b2970 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f96a006e430 tx=0x7f9690009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ef0ba7f81212a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f969effd700 1 -- 172.21.15.107:0/662031840 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690011830 con 0x7f96a006cf20 2024-05-08T21:00:28.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f969effd700 1 -- 172.21.15.107:0/662031840 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690011990 con 0x7f96a006cf20 2024-05-08T21:00:28.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f969effd700 1 -- 172.21.15.107:0/662031840 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690011d20 con 0x7f96a006cf20 2024-05-08T21:00:28.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- 172.21.15.107:0/662031840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 msgr2=0x7f96a00b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 --2- 172.21.15.107:0/662031840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a00b2970 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f96a006e430 tx=0x7f9690009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- 172.21.15.107:0/662031840 shutdown_connections 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 --2- 172.21.15.107:0/662031840 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a00b2970 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 --2- 172.21.15.107:0/662031840 >> v2:172.21.15.195:3300/0 conn(0x7f96a015bd80 0x7f96a0165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- 172.21.15.107:0/662031840 >> 172.21.15.107:0/662031840 conn(0x7f96a006d650 msgr2=0x7f96a006da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- 172.21.15.107:0/662031840 shutdown_connections 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.296+0000 7f96a5462700 1 -- 172.21.15.107:0/662031840 wait complete. 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 Processor -- start 2024-05-08T21:00:28.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 -- start start 2024-05-08T21:00:28.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a0150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a015bd80 0x7f96a015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a01656b0 0x7f96a01512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015d960 con 0x7f96a006cf20 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015dbb0 con 0x7f96a01656b0 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015de90 con 0x7f96a015bd80 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a0150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a0150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36238/0 (socket says 172.21.15.107:36238) 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 -- 172.21.15.107:0/1461985592 learned_addr learned my addr 172.21.15.107:0/1461985592 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a4c61700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a01656b0 0x7f96a01512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969f7fe700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a015bd80 0x7f96a015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 -- 172.21.15.107:0/1461985592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a015bd80 msgr2=0x7f96a015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f96a015bd80 0x7f96a015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 -- 172.21.15.107:0/1461985592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a01656b0 msgr2=0x7f96a01512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96a01656b0 0x7f96a01512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 -- 172.21.15.107:0/1461985592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009570 con 0x7f96a006cf20 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969ffff700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a0150010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f968800e9d0 tx=0x7f968800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9688009720 con 0x7f96a006cf20 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800ee70 con 0x7f96a006cf20 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a015e170 con 0x7f96a006cf20 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800ca50 con 0x7f96a006cf20 2024-05-08T21:00:28.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.300+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a015e730 con 0x7f96a006cf20 2024-05-08T21:00:28.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96a00b2eb0 con 0x7f96a006cf20 2024-05-08T21:00:28.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f968800cbb0 con 0x7f96a006cf20 2024-05-08T21:00:28.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969cff9700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9680066730 0x7f9680068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969f7fe700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9680066730 0x7f9680068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f9688084280 con 0x7f96a006cf20 2024-05-08T21:00:28.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969cff9700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f968006ebb0 0x7f9680071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 --> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9680071720 con 0x7f968006ebb0 2024-05-08T21:00:28.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9688086860 con 0x7f96a006cf20 2024-05-08T21:00:28.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f96a4c61700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f968006ebb0 0x7f9680071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.304+0000 7f969f7fe700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9680066730 0x7f9680068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f96a0162870 tx=0x7f9698009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.308+0000 7f96a4c61700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f968006ebb0 0x7f9680071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.308+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== osd.1 v2:172.21.15.107:6800/26124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9680071720 con 0x7f968006ebb0 2024-05-08T21:00:28.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 --> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96a00684b0 con 0x7f968006ebb0 2024-05-08T21:00:28.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f969cff9700 1 -- 172.21.15.107:0/1461985592 <== osd.1 v2:172.21.15.107:6800/26124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f96a00684b0 con 0x7f968006ebb0 2024-05-08T21:00:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:28.334 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f968006ebb0 msgr2=0x7f9680071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6800/26124,v1:172.21.15.107:6801/26124] conn(0x7f968006ebb0 0x7f9680071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9680066730 msgr2=0x7f9680068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9680066730 0x7f9680068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f96a0162870 tx=0x7f9698009040 comp rx=0 tx=0).stop 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 msgr2=0x7f96a0150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 --2- 172.21.15.107:0/1461985592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f96a006cf20 0x7f96a0150010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f968800e9d0 tx=0x7f968800ece0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a4c61700 1 -- 172.21.15.107:0/1461985592 reap_dead start 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 shutdown_connections 2024-05-08T21:00:28.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 >> 172.21.15.107:0/1461985592 conn(0x7f96a006d650 msgr2=0x7f96a00cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 shutdown_connections 2024-05-08T21:00:28.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.324+0000 7f96a5462700 1 -- 172.21.15.107:0/1461985592 wait complete. 2024-05-08T21:00:28.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T21:00:28.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 Processor -- start 2024-05-08T21:00:28.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- start start 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f4b900ce990 0x7f4b9015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b9015f770 0x7f4b900b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9015eda0 con 0x7f4b9015afa0 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9015ea70 con 0x7f4b9015f770 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9015ba90 con 0x7f4b900ce990 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b9015f770 0x7f4b900b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f4b9015f770 0x7f4b900b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36246/0 (socket says 172.21.15.107:36246) 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/3546854182 learned_addr learned my addr 172.21.15.107:0/3546854182 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8effd700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4b9015afa0 0x7f4b9015b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37300/0 (socket says 172.21.15.107:37300) 2024-05-08T21:00:28.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8e7fc700 1 --2- 172.21.15.107:0/3546854182 >> v2:172.21.15.195:3300/0 conn(0x7f4b900ce990 0x7f4b9015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/3546854182 >> v2:172.21.15.195:3300/0 conn(0x7f4b900ce990 msgr2=0x7f4b9015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 --2- 172.21.15.107:0/3546854182 >> v2:172.21.15.195:3300/0 conn(0x7f4b900ce990 0x7f4b9015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/3546854182 >> v1:172.21.15.107:6789/0 conn(0x7f4b9015afa0 legacy=0x7f4b9015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/3546854182 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9015bd40 con 0x7f4b9015f770 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8e7fc700 1 --2- 172.21.15.107:0/3546854182 >> v2:172.21.15.195:3300/0 conn(0x7f4b900ce990 0x7f4b9015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8f7fe700 1 --2- 172.21.15.107:0/3546854182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b900b4270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4b9006df50 tx=0x7f4b88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5888de39a1494c2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8dffb700 1 -- 172.21.15.107:0/3546854182 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800b8a0 con 0x7f4b9015f770 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8dffb700 1 -- 172.21.15.107:0/3546854182 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8800ba00 con 0x7f4b9015f770 2024-05-08T21:00:28.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8dffb700 1 -- 172.21.15.107:0/3546854182 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800bd90 con 0x7f4b9015f770 2024-05-08T21:00:28.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- 172.21.15.107:0/3546854182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 msgr2=0x7f4b900b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/3546854182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b900b4270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4b9006df50 tx=0x7f4b88009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- 172.21.15.107:0/3546854182 shutdown_connections 2024-05-08T21:00:28.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/3546854182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b900b4270 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/3546854182 >> v2:172.21.15.195:3300/0 conn(0x7f4b900ce990 0x7f4b9015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- 172.21.15.107:0/3546854182 >> 172.21.15.107:0/3546854182 conn(0x7f4b9006c330 msgr2=0x7f4b9006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- 172.21.15.107:0/3546854182 shutdown_connections 2024-05-08T21:00:28.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.456+0000 7f4b8ffff700 1 -- 172.21.15.107:0/3546854182 wait complete. 2024-05-08T21:00:28.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 Processor -- start 2024-05-08T21:00:28.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 -- start start 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b900ce990 0x7f4b901418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9015afa0 0x7f4b90154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b90154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9014d890 con 0x7f4b9015f770 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9014db70 con 0x7f4b9015afa0 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8ffff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9014de50 con 0x7f4b900ce990 2024-05-08T21:00:28.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b90154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b90154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36262/0 (socket says 172.21.15.107:36262) 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/1459588300 learned_addr learned my addr 172.21.15.107:0/1459588300 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8e7fc700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9015afa0 0x7f4b90154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8effd700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b900ce990 0x7f4b901418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b900ce990 msgr2=0x7f4b901418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b900ce990 0x7f4b901418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9015afa0 msgr2=0x7f4b90154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9015afa0 0x7f4b90154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 -- 172.21.15.107:0/1459588300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009570 con 0x7f4b9015f770 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b8f7fe700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b90154680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4b88013000 tx=0x7f4b88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.460+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88003ad0 con 0x7f4b9015f770 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8801e070 con 0x7f4b9015f770 2024-05-08T21:00:28.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88003e70 con 0x7f4b9015f770 2024-05-08T21:00:28.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9014e130 con 0x7f4b9015f770 2024-05-08T21:00:28.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b901f1bd0 con 0x7f4b9015f770 2024-05-08T21:00:28.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900684b0 con 0x7f4b9015f770 2024-05-08T21:00:28.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b88011420 con 0x7f4b9015f770 2024-05-08T21:00:28.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b777fe700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4b7c066730 0x7f4b7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b8effd700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4b7c066730 0x7f4b7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f4b88020070 con 0x7f4b9015f770 2024-05-08T21:00:28.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.464+0000 7f4b8effd700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4b7c066730 0x7f4b7c068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b90152c70 tx=0x7f4b84007d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.472+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f4b88052d70 con 0x7f4b9015f770 2024-05-08T21:00:28.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.636+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b9015c300 con 0x7f4b7c066730 2024-05-08T21:00:28.647 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b777fe700 1 -- 172.21.15.107:0/1459588300 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b84004890 con 0x7f4b7c066730 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4b7c066730 msgr2=0x7f4b7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4b7c066730 0x7f4b7c068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b90152c70 tx=0x7f4b84007d90 comp rx=0 tx=0).stop 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 msgr2=0x7f4b90154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b90154680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4b88013000 tx=0x7f4b88004770 comp rx=0 tx=0).stop 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 shutdown_connections 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b9015f770 0x7f4b90154680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9015afa0 0x7f4b90154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f4b7c066730 0x7f4b7c068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 --2- 172.21.15.107:0/1459588300 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4b900ce990 0x7f4b901418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 >> 172.21.15.107:0/1459588300 conn(0x7f4b9006c330 msgr2=0x7f4b900af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.650 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 shutdown_connections 2024-05-08T21:00:28.651 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.640+0000 7f4b8ffff700 1 -- 172.21.15.107:0/1459588300 wait complete. 2024-05-08T21:00:28.651 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T21:00:28.662 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T21:00:28.662 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:28.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.772+0000 7f584ffff700 1 Processor -- start 2024-05-08T21:00:28.782 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.772+0000 7f584ffff700 1 -- start start 2024-05-08T21:00:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d0d0 0x7f58500cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f585015d4b0 0x7f58500cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58500cdaf0 con 0x7f58500d15c0 2024-05-08T21:00:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58500d3a80 con 0x7f585015d4b0 2024-05-08T21:00:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500cdd90 con 0x7f585015d0d0 2024-05-08T21:00:28.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f585015d4b0 0x7f58500cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f585015d4b0 0x7f58500cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36274/0 (socket says 172.21.15.107:36274) 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 -- 172.21.15.107:0/1612450103 learned_addr learned my addr 172.21.15.107:0/1612450103 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584effd700 1 --2- 172.21.15.107:0/1612450103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d0d0 0x7f58500cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 -- 172.21.15.107:0/1612450103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d0d0 msgr2=0x7f58500cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 --2- 172.21.15.107:0/1612450103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d0d0 0x7f58500cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 -- 172.21.15.107:0/1612450103 >> v1:172.21.15.195:6789/0 conn(0x7f58500d15c0 legacy=0x7f5850160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 -- 172.21.15.107:0/1612450103 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58500ce070 con 0x7f585015d4b0 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584e7fc700 1 --2- 172.21.15.107:0/1612450103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d4b0 0x7f58500cfe80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5838009910 tx=0x7f5838009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c31be921b1b81b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584dffb700 1 -- 172.21.15.107:0/1612450103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800ba60 con 0x7f585015d4b0 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584dffb700 1 -- 172.21.15.107:0/1612450103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800bbc0 con 0x7f585015d4b0 2024-05-08T21:00:28.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584dffb700 1 -- 172.21.15.107:0/1612450103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838009e60 con 0x7f585015d4b0 2024-05-08T21:00:28.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- 172.21.15.107:0/1612450103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d4b0 msgr2=0x7f58500cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 --2- 172.21.15.107:0/1612450103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d4b0 0x7f58500cfe80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5838009910 tx=0x7f5838009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:28.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- 172.21.15.107:0/1612450103 shutdown_connections 2024-05-08T21:00:28.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 --2- 172.21.15.107:0/1612450103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d4b0 0x7f58500cfe80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 --2- 172.21.15.107:0/1612450103 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d0d0 0x7f58500cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- 172.21.15.107:0/1612450103 >> 172.21.15.107:0/1612450103 conn(0x7f585009c2f0 msgr2=0x7f58500d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- 172.21.15.107:0/1612450103 shutdown_connections 2024-05-08T21:00:28.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.776+0000 7f584ffff700 1 -- 172.21.15.107:0/1612450103 wait complete. 2024-05-08T21:00:28.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 Processor -- start 2024-05-08T21:00:28.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 -- start start 2024-05-08T21:00:28.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58500d15c0 0x7f585014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d0d0 0x7f58500b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d4b0 0x7f585006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585014b9d0 con 0x7f585015d0d0 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b6eb0 con 0x7f58500d15c0 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58500b8820 con 0x7f585015d4b0 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d0d0 0x7f58500b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d0d0 0x7f58500b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36290/0 (socket says 172.21.15.107:36290) 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 -- 172.21.15.107:0/192240312 learned_addr learned my addr 172.21.15.107:0/192240312 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584effd700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58500d15c0 0x7f585014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584f7fe700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d4b0 0x7f585006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 -- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d4b0 msgr2=0x7f585006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d4b0 0x7f585006bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 -- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58500d15c0 msgr2=0x7f585014b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58500d15c0 0x7f585014b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 -- 172.21.15.107:0/192240312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838009570 con 0x7f585015d0d0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584f7fe700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f585015d4b0 0x7f585006bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584e7fc700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d0d0 0x7f58500b6970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f585008c6c0 tx=0x7f5838004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838004500 con 0x7f585015d0d0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380036c0 con 0x7f585015d0d0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58500b5bb0 con 0x7f585015d0d0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838003a50 con 0x7f585015d0d0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.780+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58500b6170 con 0x7f585015d0d0 2024-05-08T21:00:28.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58500ce910 con 0x7f585015d0d0 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5838003bb0 con 0x7f585015d0d0 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f58477fe700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5830066760 0x7f5830068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f5838021030 con 0x7f585015d0d0 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f584effd700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5830066760 0x7f5830068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f58477fe700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7f583006ebe0 0x7f5830071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 --> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5830071750 con 0x7f583006ebe0 2024-05-08T21:00:28.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f583808a2c0 con 0x7f585015d0d0 2024-05-08T21:00:28.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.784+0000 7f584f7fe700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7f583006ebe0 0x7f5830071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.788+0000 7f584effd700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5830066760 0x7f5830068c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5840009950 tx=0x7f5840008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.788+0000 7f584f7fe700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7f583006ebe0 0x7f5830071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.788+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== osd.2 v2:172.21.15.107:6816/26127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5830071750 con 0x7f583006ebe0 2024-05-08T21:00:28.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 --> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58500ce630 con 0x7f583006ebe0 2024-05-08T21:00:28.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f58477fe700 1 -- 172.21.15.107:0/192240312 <== osd.2 v2:172.21.15.107:6816/26127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5848012380 con 0x7f583006ebe0 2024-05-08T21:00:28.815 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:28.815 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:28.816 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7f583006ebe0 msgr2=0x7f5830071080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6816/26127,v1:172.21.15.107:6817/26127] conn(0x7f583006ebe0 0x7f5830071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5830066760 msgr2=0x7f5830068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5830066760 0x7f5830068c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5840009950 tx=0x7f5840008040 comp rx=0 tx=0).stop 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d0d0 msgr2=0x7f58500b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 --2- 172.21.15.107:0/192240312 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f585015d0d0 0x7f58500b6970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f585008c6c0 tx=0x7f5838004770 comp rx=0 tx=0).stop 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584f7fe700 1 -- 172.21.15.107:0/192240312 reap_dead start 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 shutdown_connections 2024-05-08T21:00:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 >> 172.21.15.107:0/192240312 conn(0x7f585009c2f0 msgr2=0x7f58500b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 shutdown_connections 2024-05-08T21:00:28.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.808+0000 7f584ffff700 1 -- 172.21.15.107:0/192240312 wait complete. 2024-05-08T21:00:28.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T21:00:28.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98b1a4e700 1 Processor -- start 2024-05-08T21:00:28.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98b1a4e700 1 -- start start 2024-05-08T21:00:28.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98b1a4e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f98ac1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98b1a4e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac1656a0 con 0x7f98ac165240 2024-05-08T21:00:28.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98b1a4e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac165970 con 0x7f98ac144d40 2024-05-08T21:00:28.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98b1a4e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac161c50 con 0x7f98ac0cb3b0 2024-05-08T21:00:28.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98aa7fc700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f98ac165240 0x7f98ac162360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37304/0 (socket says 172.21.15.107:37304) 2024-05-08T21:00:28.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98aa7fc700 1 -- 172.21.15.107:0/3113439495 learned_addr learned my addr 172.21.15.107:0/3113439495 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:28.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98aaffd700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f98ac1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.940+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063702721 0 0) 0x7f98ac1656a0 con 0x7f98ac165240 2024-05-08T21:00:28.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98980035d0 con 0x7f98ac165240 2024-05-08T21:00:28.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892875697 0 0) 0x7f98ac165970 con 0x7f98ac144d40 2024-05-08T21:00:28.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac1656a0 con 0x7f98ac144d40 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427014949 0 0) 0x7f98980035d0 con 0x7f98ac165240 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 msgr2=0x7f98ac1478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f98ac1478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 >> v1:172.21.15.195:6789/0 conn(0x7f98ac144d40 legacy=0x7f98ac06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac165c50 con 0x7f98ac165240 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7f989c0019f0 con 0x7f98ac165240 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 >> v1:172.21.15.107:6789/0 conn(0x7f98ac165240 legacy=0x7f98ac162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9898003be0 0x7f9898003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f9898004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898004db0 0x7f9898005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989800bae0 con 0x7f9898003be0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989800bc20 con 0x7f9898004db0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989800bd90 con 0x7f98ac0cb3b0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9898003be0 0x7f9898003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aa7fc700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f9898004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98ab7fe700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898004db0 0x7f9898005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 -- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 msgr2=0x7f9898004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f9898004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 -- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898004db0 msgr2=0x7f9898005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898004db0 0x7f9898005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 -- 172.21.15.107:0/3113439495 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980035d0 con 0x7f9898003be0 2024-05-08T21:00:28.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aa7fc700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac0cb3b0 0x7f9898004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98ab7fe700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898004db0 0x7f9898005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98aaffd700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9898003be0 0x7f9898003fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9894009b70 tx=0x7f98980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24e70e28e733ca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400e6c0 con 0x7f9898003be0 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400e820 con 0x7f9898003be0 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98a9ffb700 1 -- 172.21.15.107:0/3113439495 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400eb90 con 0x7f9898003be0 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98b1a4e700 1 -- 172.21.15.107:0/3113439495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9898003be0 msgr2=0x7f9898003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/3113439495 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9898003be0 0x7f9898003fe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9894009b70 tx=0x7f98980058a0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98ab7fe700 1 -- 172.21.15.107:0/3113439495 reap_dead start 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98b1a4e700 1 -- 172.21.15.107:0/3113439495 shutdown_connections 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98b1a4e700 1 -- 172.21.15.107:0/3113439495 >> 172.21.15.107:0/3113439495 conn(0x7f98ac06a360 msgr2=0x7f98ac06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:28.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98b1a4e700 1 -- 172.21.15.107:0/3113439495 shutdown_connections 2024-05-08T21:00:28.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.944+0000 7f98b1a4e700 1 -- 172.21.15.107:0/3113439495 wait complete. 2024-05-08T21:00:28.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 Processor -- start 2024-05-08T21:00:28.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 -- start start 2024-05-08T21:00:28.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898003be0 0x7f98ac141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac15b210 0x7f98ac1608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 0x7f98ac162260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac15adf0 con 0x7f98ac160e00 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac161280 con 0x7f9898003be0 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac15a4e0 con 0x7f98ac15b210 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 0x7f98ac162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98aaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898003be0 0x7f98ac141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 0x7f98ac162260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36310/0 (socket says 172.21.15.107:36310) 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98aa7fc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac15b210 0x7f98ac1608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98aaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898003be0 0x7f98ac141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:39120/0 (socket says 172.21.15.107:39120) 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 -- 172.21.15.107:0/2669334842 learned_addr learned my addr 172.21.15.107:0/2669334842 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 -- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac15b210 msgr2=0x7f98ac1608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac15b210 0x7f98ac1608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 -- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898003be0 msgr2=0x7f98ac141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898003be0 0x7f98ac141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 -- 172.21.15.107:0/2669334842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac162f90 con 0x7f98ac160e00 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98aa7fc700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac15b210 0x7f98ac1608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98ab7fe700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 0x7f98ac162260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0b4290 tx=0x7f98a400e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40050d0 con 0x7f98ac160e00 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4005250 con 0x7f98ac160e00 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac15a730 con 0x7f98ac160e00 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40036a0 con 0x7f98ac160e00 2024-05-08T21:00:28.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.948+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac142490 con 0x7f98ac160e00 2024-05-08T21:00:28.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.952+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac0684b0 con 0x7f98ac160e00 2024-05-08T21:00:28.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.952+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98a4003800 con 0x7f98ac160e00 2024-05-08T21:00:28.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.952+0000 7f98a3fff700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f988c066730 0x7f988c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:28.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.952+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f98a4083100 con 0x7f98ac160e00 2024-05-08T21:00:28.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.952+0000 7f98aaffd700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f988c066730 0x7f988c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:28.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.956+0000 7f98aaffd700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f988c066730 0x7f988c068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f98940090b0 tx=0x7f989401e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:28.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:28.960+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f98a4050430 con 0x7f98ac160e00 2024-05-08T21:00:29.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.128+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f98ac161e40 con 0x7f988c066730 2024-05-08T21:00:29.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98a3fff700 1 -- 172.21.15.107:0/2669334842 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f989400ea10 con 0x7f988c066730 2024-05-08T21:00:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f988c066730 msgr2=0x7f988c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f988c066730 0x7f988c068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f98940090b0 tx=0x7f989401e040 comp rx=0 tx=0).stop 2024-05-08T21:00:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 msgr2=0x7f98ac162260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 0x7f98ac162260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0b4290 tx=0x7f98a400e7b0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 shutdown_connections 2024-05-08T21:00:29.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98ac160e00 0x7f98ac162260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f988c066730 0x7f988c068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98ac15b210 0x7f98ac1608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 --2- 172.21.15.107:0/2669334842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9898003be0 0x7f98ac141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 >> 172.21.15.107:0/2669334842 conn(0x7f98ac06a360 msgr2=0x7f98ac1453b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 shutdown_connections 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.132+0000 7f98b1a4e700 1 -- 172.21.15.107:0/2669334842 wait complete. 2024-05-08T21:00:29.143 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T21:00:29.154 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T21:00:29.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:29.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.264+0000 7fc4595dc700 1 Processor -- start 2024-05-08T21:00:29.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.264+0000 7fc4595dc700 1 -- start start 2024-05-08T21:00:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc4540d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4540d1200 0x7fc4540d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fc4540d35c0 0x7fc4540cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4540d3a20 con 0x7fc4540d1200 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45415d850 con 0x7fc4540d35c0 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540d16d0 con 0x7fc45415d470 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4540d1200 0x7fc4540d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc4540d1200 0x7fc4540d3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36322/0 (socket says 172.21.15.107:36322) 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 -- 172.21.15.107:0/3093120673 learned_addr learned my addr 172.21.15.107:0/3093120673 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc458ddb700 1 --2- 172.21.15.107:0/3093120673 >> v2:172.21.15.195:3300/0 conn(0x7fc4540d35c0 0x7fc4540cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc453fff700 1 --2- 172.21.15.107:0/3093120673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc4540d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 -- 172.21.15.107:0/3093120673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 msgr2=0x7fc4540d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 --2- 172.21.15.107:0/3093120673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc4540d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 -- 172.21.15.107:0/3093120673 >> v2:172.21.15.195:3300/0 conn(0x7fc4540d35c0 msgr2=0x7fc4540cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 --2- 172.21.15.107:0/3093120673 >> v2:172.21.15.195:3300/0 conn(0x7fc4540d35c0 0x7fc4540cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 -- 172.21.15.107:0/3093120673 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4540d19b0 con 0x7fc4540d1200 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4537fe700 1 --2- 172.21.15.107:0/3093120673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d1200 0x7fc4540d3080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc4540d2d70 tx=0x7fc444009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d7ea760f6a31d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc452ffd700 1 -- 172.21.15.107:0/3093120673 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444011830 con 0x7fc4540d1200 2024-05-08T21:00:29.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc452ffd700 1 -- 172.21.15.107:0/3093120673 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444011990 con 0x7fc4540d1200 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc452ffd700 1 -- 172.21.15.107:0/3093120673 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444011d20 con 0x7fc4540d1200 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- 172.21.15.107:0/3093120673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d1200 msgr2=0x7fc4540d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- 172.21.15.107:0/3093120673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d1200 0x7fc4540d3080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc4540d2d70 tx=0x7fc444009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- 172.21.15.107:0/3093120673 shutdown_connections 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- 172.21.15.107:0/3093120673 >> v2:172.21.15.195:3300/0 conn(0x7fc4540d35c0 0x7fc4540cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- 172.21.15.107:0/3093120673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d1200 0x7fc4540d3080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 --2- 172.21.15.107:0/3093120673 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc4540d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- 172.21.15.107:0/3093120673 >> 172.21.15.107:0/3093120673 conn(0x7fc45408b000 msgr2=0x7fc45409c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- 172.21.15.107:0/3093120673 shutdown_connections 2024-05-08T21:00:29.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 -- 172.21.15.107:0/3093120673 wait complete. 2024-05-08T21:00:29.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.268+0000 7fc4595dc700 1 Processor -- start 2024-05-08T21:00:29.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 -- start start 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4540d1200 0x7fc45415f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d35c0 0x7fc4540cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc45415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45415d9c0 con 0x7fc4540d35c0 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541f2eb0 con 0x7fc4540d1200 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541f3190 con 0x7fc45415d470 2024-05-08T21:00:29.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d35c0 0x7fc4540cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d35c0 0x7fc4540cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36332/0 (socket says 172.21.15.107:36332) 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 -- 172.21.15.107:0/904188880 learned_addr learned my addr 172.21.15.107:0/904188880 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc453fff700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4540d1200 0x7fc45415f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc458ddb700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc45415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 -- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 msgr2=0x7fc45415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc45415de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 -- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4540d1200 msgr2=0x7fc45415f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc4540d1200 0x7fc45415f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 -- 172.21.15.107:0/904188880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc444009570 con 0x7fc4540d35c0 2024-05-08T21:00:29.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc458ddb700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fc45415d470 0x7fc45415de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:00:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4537fe700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d35c0 0x7fc4540cc570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc444000c00 tx=0x7fc444004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444004590 con 0x7fc4540d35c0 2024-05-08T21:00:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44401e070 con 0x7fc4540d35c0 2024-05-08T21:00:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4541f3470 con 0x7fc4540d35c0 2024-05-08T21:00:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440038e0 con 0x7fc4540d35c0 2024-05-08T21:00:29.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.272+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45415fdc0 con 0x7fc4540d35c0 2024-05-08T21:00:29.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4540d1f70 con 0x7fc4540d35c0 2024-05-08T21:00:29.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc444003a40 con 0x7fc4540d35c0 2024-05-08T21:00:29.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc450ff9700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc434066760 0x7fc434068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fc444084c40 con 0x7fc4540d35c0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc453fff700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc434066760 0x7fc434068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc450ff9700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7fc43406ebe0 0x7fc434071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 --> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc434071750 con 0x7fc43406ebe0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc444087300 con 0x7fc4540d35c0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc458ddb700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7fc43406ebe0 0x7fc434071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc453fff700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc434066760 0x7fc434068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc4540c9ef0 tx=0x7fc43c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.276+0000 7fc458ddb700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7fc43406ebe0 0x7fc434071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.287 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.280+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== osd.3 v2:172.21.15.107:6808/26125 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc434071750 con 0x7fc43406ebe0 2024-05-08T21:00:29.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 --> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc45415db00 con 0x7fc43406ebe0 2024-05-08T21:00:29.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc450ff9700 1 -- 172.21.15.107:0/904188880 <== osd.3 v2:172.21.15.107:6808/26125 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc45415db00 con 0x7fc43406ebe0 2024-05-08T21:00:29.305 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:29.305 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7fc43406ebe0 msgr2=0x7fc434071080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6808/26125,v1:172.21.15.107:6809/26125] conn(0x7fc43406ebe0 0x7fc434071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc434066760 msgr2=0x7fc434068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fc434066760 0x7fc434068c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc4540c9ef0 tx=0x7fc43c008040 comp rx=0 tx=0).stop 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d35c0 msgr2=0x7fc4540cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 --2- 172.21.15.107:0/904188880 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc4540d35c0 0x7fc4540cc570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc444000c00 tx=0x7fc444004770 comp rx=0 tx=0).stop 2024-05-08T21:00:29.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc458ddb700 1 -- 172.21.15.107:0/904188880 reap_dead start 2024-05-08T21:00:29.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 shutdown_connections 2024-05-08T21:00:29.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 >> 172.21.15.107:0/904188880 conn(0x7fc45408b000 msgr2=0x7fc4540cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 shutdown_connections 2024-05-08T21:00:29.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.296+0000 7fc4595dc700 1 -- 172.21.15.107:0/904188880 wait complete. 2024-05-08T21:00:29.323 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T21:00:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.424+0000 7fd1a89c3700 1 Processor -- start 2024-05-08T21:00:29.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.424+0000 7fd1a89c3700 1 -- start start 2024-05-08T21:00:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1a413ffc0 0x7fd1a415ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1a41403a0 0x7fd1a406b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a406f3f0 con 0x7fd1a40cbfb0 2024-05-08T21:00:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a415b3a0 con 0x7fd1a41403a0 2024-05-08T21:00:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a415db00 con 0x7fd1a413ffc0 2024-05-08T21:00:29.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1a41403a0 0x7fd1a406b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a37fe700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd1a413ffc0 0x7fd1a415ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd1a41403a0 0x7fd1a406b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36338/0 (socket says 172.21.15.107:36338) 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 -- 172.21.15.107:0/1328212865 learned_addr learned my addr 172.21.15.107:0/1328212865 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 -- 172.21.15.107:0/1328212865 >> v2:172.21.15.195:3300/0 conn(0x7fd1a413ffc0 msgr2=0x7fd1a415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 --2- 172.21.15.107:0/1328212865 >> v2:172.21.15.195:3300/0 conn(0x7fd1a413ffc0 0x7fd1a415ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 -- 172.21.15.107:0/1328212865 >> v1:172.21.15.195:6789/0 conn(0x7fd1a40cbfb0 legacy=0x7fd1a40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 -- 172.21.15.107:0/1328212865 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40cc4e0 con 0x7fd1a41403a0 2024-05-08T21:00:29.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a2ffd700 1 --2- 172.21.15.107:0/1328212865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a406b370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009910 tx=0x7fd18c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d6bcff3ccb2280 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a27fc700 1 -- 172.21.15.107:0/1328212865 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011830 con 0x7fd1a41403a0 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a27fc700 1 -- 172.21.15.107:0/1328212865 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c011990 con 0x7fd1a41403a0 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a27fc700 1 -- 172.21.15.107:0/1328212865 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011d40 con 0x7fd1a41403a0 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 -- 172.21.15.107:0/1328212865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 msgr2=0x7fd1a406b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/1328212865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a406b370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009910 tx=0x7fd18c009c20 comp rx=0 tx=0).stop 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 -- 172.21.15.107:0/1328212865 shutdown_connections 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/1328212865 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a406b370 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/1328212865 >> v2:172.21.15.195:3300/0 conn(0x7fd1a413ffc0 0x7fd1a415ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.428+0000 7fd1a89c3700 1 -- 172.21.15.107:0/1328212865 >> 172.21.15.107:0/1328212865 conn(0x7fd1a40709c0 msgr2=0x7fd1a4070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 -- 172.21.15.107:0/1328212865 shutdown_connections 2024-05-08T21:00:29.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 -- 172.21.15.107:0/1328212865 wait complete. 2024-05-08T21:00:29.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 Processor -- start 2024-05-08T21:00:29.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 -- start start 2024-05-08T21:00:29.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 0x7fd1a40caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a413ffc0 0x7fd1a41431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a41f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a40aa770 con 0x7fd1a41403a0 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4143720 con 0x7fd1a413ffc0 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a89c3700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a4142c00 con 0x7fd1a40cbfb0 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a41f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a413ffc0 0x7fd1a41431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a37fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 0x7fd1a40caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a37fe700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 0x7fd1a40caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:38902/0 (socket says 172.21.15.107:38902) 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a41f08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36352/0 (socket says 172.21.15.107:36352) 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a413ffc0 0x7fd1a41431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:39142/0 (socket says 172.21.15.107:39142) 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a37fe700 1 -- 172.21.15.107:0/3403222659 learned_addr learned my addr 172.21.15.107:0/3403222659 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 -- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 msgr2=0x7fd1a40caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 0x7fd1a40caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 -- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a413ffc0 msgr2=0x7fd1a41431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a413ffc0 0x7fd1a41431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a3fff700 1 -- 172.21.15.107:0/3403222659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009570 con 0x7fd1a41403a0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.432+0000 7fd1a37fe700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 0x7fd1a40caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd1a3fff700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a41f08c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd19c001eb0 tx=0x7fd19c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0052d0 con 0x7fd1a41403a0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19c005430 con 0x7fd1a41403a0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a40ac150 con 0x7fd1a41403a0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19c0055a0 con 0x7fd1a41403a0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a40ac710 con 0x7fd1a41403a0 2024-05-08T21:00:29.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a415a110 con 0x7fd1a41403a0 2024-05-08T21:00:29.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.436+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd19c003af0 con 0x7fd1a41403a0 2024-05-08T21:00:29.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.440+0000 7fd19bfff700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd184066730 0x7fd184068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.440+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fd19c083680 con 0x7fd1a41403a0 2024-05-08T21:00:29.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.440+0000 7fd1a37fe700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd184066730 0x7fd184068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.440+0000 7fd1a37fe700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd184066730 0x7fd184068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd194009a40 tx=0x7fd19400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.444+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fd19c050920 con 0x7fd1a41403a0 2024-05-08T21:00:29.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1a40cc7c0 con 0x7fd184066730 2024-05-08T21:00:29.627 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd19bfff700 1 -- 172.21.15.107:0/3403222659 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd19400f040 con 0x7fd184066730 2024-05-08T21:00:29.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd184066730 msgr2=0x7fd184068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd184066730 0x7fd184068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd194009a40 tx=0x7fd19400b040 comp rx=0 tx=0).stop 2024-05-08T21:00:29.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 msgr2=0x7fd1a41f08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a41f08c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd19c001eb0 tx=0x7fd19c00c6e0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 shutdown_connections 2024-05-08T21:00:29.630 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd1a41403a0 0x7fd1a41f08c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1a413ffc0 0x7fd1a41431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fd184066730 0x7fd184068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 --2- 172.21.15.107:0/3403222659 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd1a40cbfb0 0x7fd1a40caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 >> 172.21.15.107:0/3403222659 conn(0x7fd1a40709c0 msgr2=0x7fd1a406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 shutdown_connections 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.620+0000 7fd1a89c3700 1 -- 172.21.15.107:0/3403222659 wait complete. 2024-05-08T21:00:29.631 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T21:00:29.642 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T21:00:29.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4e4d9700 1 Processor -- start 2024-05-08T21:00:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4e4d9700 1 -- start start 2024-05-08T21:00:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4e4d9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d480ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4e4d9700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480b1ac0 con 0x7f6d48144860 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4e4d9700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480b0c60 con 0x7f6d480cb9e0 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4e4d9700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480cedb0 con 0x7f6d4806cf20 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4d4d7700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f6d48144860 0x7f6d4815ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37314/0 (socket says 172.21.15.107:37314) 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4d4d7700 1 -- 172.21.15.107:0/267357988 learned_addr learned my addr 172.21.15.107:0/267357988 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d480ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214203830 0 0) 0x7f6d480b1ac0 con 0x7f6d48144860 2024-05-08T21:00:29.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.752+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d300035d0 con 0x7f6d48144860 2024-05-08T21:00:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2724122656 0 0) 0x7f6d300035d0 con 0x7f6d48144860 2024-05-08T21:00:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 msgr2=0x7f6d480ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d480ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 >> v1:172.21.15.195:6789/0 conn(0x7f6d480cb9e0 legacy=0x7f6d4806c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480b0f40 con 0x7f6d48144860 2024-05-08T21:00:29.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7f6d40001670 con 0x7f6d48144860 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d480ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 >> v1:172.21.15.107:6789/0 conn(0x7f6d48144860 legacy=0x7f6d4815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d30003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d30003f90 0x7f6d30004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d30004db0 0x7f6d30005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480cedb0 con 0x7f6d30003f90 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3000ba90 con 0x7f6d30004db0 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3000bc50 con 0x7f6d4806cf20 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d30003f90 0x7f6d30004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4d4d7700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d30003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d30004db0 0x7f6d30005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 -- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 msgr2=0x7f6d30003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d4806cf20 0x7f6d30003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 -- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d30004db0 msgr2=0x7f6d30005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d30004db0 0x7f6d30005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 -- 172.21.15.107:0/267357988 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009a70 con 0x7f6d30003f90 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d30004db0 0x7f6d30005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4ccd6700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d30003f90 0x7f6d30004870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0018f0 tx=0x7f6d300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e65a9780f1c69a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c001390 con 0x7f6d30003f90 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c012620 con 0x7f6d30003f90 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d47fff700 1 -- 172.21.15.107:0/267357988 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0129d0 con 0x7f6d30003f90 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/267357988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d30003f90 msgr2=0x7f6d30004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4e4d9700 1 --2- 172.21.15.107:0/267357988 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d30003f90 0x7f6d30004870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0018f0 tx=0x7f6d300058a0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4dcd8700 1 -- 172.21.15.107:0/267357988 reap_dead start 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/267357988 shutdown_connections 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/267357988 >> 172.21.15.107:0/267357988 conn(0x7f6d4806d650 msgr2=0x7f6d4806da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/267357988 shutdown_connections 2024-05-08T21:00:29.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.756+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/267357988 wait complete. 2024-05-08T21:00:29.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 Processor -- start 2024-05-08T21:00:29.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 -- start start 2024-05-08T21:00:29.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d481f0570 0x7f6d480ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d480ae610 0x7f6d48140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d48140870 0x7f6d481f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48140cf0 con 0x7f6d48140870 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d481f0950 con 0x7f6d480ae610 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480a8820 con 0x7f6d481f0570 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d48140870 0x7f6d481f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4d4d7700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d481f0570 0x7f6d480ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4ccd6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d480ae610 0x7f6d48140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4d4d7700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d481f0570 0x7f6d480ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:38926/0 (socket says 172.21.15.107:38926) 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d48140870 0x7f6d481f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36360/0 (socket says 172.21.15.107:36360) 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4d4d7700 1 -- 172.21.15.107:0/1854798665 learned_addr learned my addr 172.21.15.107:0/1854798665 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 -- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d481f0570 msgr2=0x7f6d480ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d481f0570 0x7f6d480ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.772 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 -- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d480ae610 msgr2=0x7f6d48140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6d480ae610 0x7f6d48140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 -- 172.21.15.107:0/1854798665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d480a8b00 con 0x7f6d48140870 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4d4d7700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f6d481f0570 0x7f6d480ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4dcd8700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d48140870 0x7f6d481f3ff0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d480b4430 tx=0x7f6d380114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800e030 con 0x7f6d48140870 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38011c30 con 0x7f6d48140870 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480a8de0 con 0x7f6d48140870 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38016470 con 0x7f6d48140870 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.760+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480a93a0 con 0x7f6d48140870 2024-05-08T21:00:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d480b17e0 con 0x7f6d48140870 2024-05-08T21:00:29.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6d380165d0 con 0x7f6d48140870 2024-05-08T21:00:29.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d45ffb700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6d34066760 0x7f6d34068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f6d3800f070 con 0x7f6d48140870 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d4d4d7700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6d34066760 0x7f6d34068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d45ffb700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f6d3406ebe0 0x7f6d34071080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 --> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d34071750 con 0x7f6d3406ebe0 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d38086c90 con 0x7f6d48140870 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d4ccd6700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f6d3406ebe0 0x7f6d34071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d4d4d7700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6d34066760 0x7f6d34068c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001050 tx=0x7f6d40000f80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.764+0000 7f6d4ccd6700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f6d3406ebe0 0x7f6d34071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.768+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== osd.4 v2:172.21.15.195:6808/26319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6d34071750 con 0x7f6d3406ebe0 2024-05-08T21:00:29.793 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.784+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 --> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d480b1500 con 0x7f6d3406ebe0 2024-05-08T21:00:29.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.784+0000 7f6d45ffb700 1 -- 172.21.15.107:0/1854798665 <== osd.4 v2:172.21.15.195:6808/26319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d3c023040 con 0x7f6d3406ebe0 2024-05-08T21:00:29.794 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:29.795 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:29.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.784+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f6d3406ebe0 msgr2=0x7f6d34071080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.784+0000 7f6d4e4d9700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.195:6808/26319,v1:172.21.15.195:6809/26319] conn(0x7f6d3406ebe0 0x7f6d34071080 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6d34066760 msgr2=0x7f6d34068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6d34066760 0x7f6d34068c20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001050 tx=0x7f6d40000f80 comp rx=0 tx=0).stop 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d48140870 msgr2=0x7f6d481f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 --2- 172.21.15.107:0/1854798665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6d48140870 0x7f6d481f3ff0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6d480b4430 tx=0x7f6d380114b0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4dcd8700 1 -- 172.21.15.107:0/1854798665 reap_dead start 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 shutdown_connections 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 >> 172.21.15.107:0/1854798665 conn(0x7f6d4806d650 msgr2=0x7f6d4815f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 shutdown_connections 2024-05-08T21:00:29.796 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.788+0000 7f6d4e4d9700 1 -- 172.21.15.107:0/1854798665 wait complete. 2024-05-08T21:00:29.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T21:00:29.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 Processor -- start 2024-05-08T21:00:29.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 -- start start 2024-05-08T21:00:29.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9800159a80 0x7f9800159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f98000709a0 0x7f9800070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98000b3590 con 0x7f98001596a0 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000b5020 con 0x7f98000709a0 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f9804d58700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98000b24f0 con 0x7f9800159a80 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f98000709a0 0x7f9800070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f98000709a0 0x7f9800070e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36376/0 (socket says 172.21.15.107:36376) 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 -- 172.21.15.107:0/2817702681 learned_addr learned my addr 172.21.15.107:0/2817702681 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97f7fff700 1 --2- 172.21.15.107:0/2817702681 >> v2:172.21.15.195:3300/0 conn(0x7f9800159a80 0x7f9800159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 -- 172.21.15.107:0/2817702681 >> v2:172.21.15.195:3300/0 conn(0x7f9800159a80 msgr2=0x7f9800159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 --2- 172.21.15.107:0/2817702681 >> v2:172.21.15.195:3300/0 conn(0x7f9800159a80 0x7f9800159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 -- 172.21.15.107:0/2817702681 >> v1:172.21.15.107:6789/0 conn(0x7f98001596a0 legacy=0x7f98000b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97feffd700 1 -- 172.21.15.107:0/2817702681 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625267985 0 0) 0x7f98000b3590 con 0x7f98001596a0 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 -- 172.21.15.107:0/2817702681 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000b27d0 con 0x7f98000709a0 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97f7fff700 1 --2- 172.21.15.107:0/2817702681 >> v2:172.21.15.195:3300/0 conn(0x7f9800159a80 0x7f9800159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:29.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97fffff700 1 --2- 172.21.15.107:0/2817702681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000709a0 0x7f9800070e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f980015e080 tx=0x7f97f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3676e3f715060590 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.916+0000 7f97feffd700 1 -- 172.21.15.107:0/2817702681 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800e070 con 0x7f98000709a0 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97feffd700 1 -- 172.21.15.107:0/2817702681 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f800b9c0 con 0x7f98000709a0 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97feffd700 1 -- 172.21.15.107:0/2817702681 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800bd70 con 0x7f98000709a0 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- 172.21.15.107:0/2817702681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000709a0 msgr2=0x7f9800070e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 --2- 172.21.15.107:0/2817702681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000709a0 0x7f9800070e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f980015e080 tx=0x7f97f800b330 comp rx=0 tx=0).stop 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- 172.21.15.107:0/2817702681 shutdown_connections 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 --2- 172.21.15.107:0/2817702681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f98000709a0 0x7f9800070e10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 --2- 172.21.15.107:0/2817702681 >> v2:172.21.15.195:3300/0 conn(0x7f9800159a80 0x7f9800159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- 172.21.15.107:0/2817702681 >> 172.21.15.107:0/2817702681 conn(0x7f980006c330 msgr2=0x7f980006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- 172.21.15.107:0/2817702681 shutdown_connections 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- 172.21.15.107:0/2817702681 wait complete. 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 Processor -- start 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- start start 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98000709a0 0x7f9800153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98001596a0 0x7f98001545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 0x7f9800154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98000ae020 con 0x7f9800159a80 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800155e00 con 0x7f98000709a0 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f9804d58700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98001551f0 con 0x7f98001596a0 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 0x7f9800154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 0x7f9800154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36392/0 (socket says 172.21.15.107:36392) 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 -- 172.21.15.107:0/3421332287 learned_addr learned my addr 172.21.15.107:0/3421332287 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:29.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97ff7fe700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98000709a0 0x7f9800153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97f7fff700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98001596a0 0x7f98001545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 -- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98001596a0 msgr2=0x7f98001545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98001596a0 0x7f98001545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 -- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98000709a0 msgr2=0x7f9800153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98000709a0 0x7f9800153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 -- 172.21.15.107:0/3421332287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8009b30 con 0x7f9800159a80 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97ff7fe700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98000709a0 0x7f9800153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.920+0000 7f97fffff700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 0x7f9800154b20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f98000725c0 tx=0x7f97f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80048f0 con 0x7f9800159a80 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80099b0 con 0x7f9800159a80 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98001554d0 con 0x7f9800159a80 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f801b670 con 0x7f9800159a80 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9800155a90 con 0x7f9800159a80 2024-05-08T21:00:29.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98000684b0 con 0x7f9800159a80 2024-05-08T21:00:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97f801b7d0 con 0x7f9800159a80 2024-05-08T21:00:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97fcff9700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f97e0066730 0x7f97e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f97f8085a10 con 0x7f9800159a80 2024-05-08T21:00:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.924+0000 7f97ff7fe700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f97e0066730 0x7f97e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.928+0000 7f97ff7fe700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f97e0066730 0x7f97e0068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97f0000f60 tx=0x7f97f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:29.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:29.932+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f97f8052d40 con 0x7f9800159a80 2024-05-08T21:00:30.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.100+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f98000b3070 con 0x7f97e0066730 2024-05-08T21:00:30.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.100+0000 7f97fcff9700 1 -- 172.21.15.107:0/3421332287 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f97f0001490 con 0x7f97e0066730 2024-05-08T21:00:30.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f97e0066730 msgr2=0x7f97e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f97e0066730 0x7f97e0068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f97f0000f60 tx=0x7f97f0009040 comp rx=0 tx=0).stop 2024-05-08T21:00:30.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 msgr2=0x7f9800154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 0x7f9800154b20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f98000725c0 tx=0x7f97f8004af0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 shutdown_connections 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9800159a80 0x7f9800154b20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f97e0066730 0x7f97e0068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f98001596a0 0x7f98001545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 --2- 172.21.15.107:0/3421332287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98000709a0 0x7f9800153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 >> 172.21.15.107:0/3421332287 conn(0x7f980006c330 msgr2=0x7f980006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 shutdown_connections 2024-05-08T21:00:30.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.104+0000 7f9804d58700 1 -- 172.21.15.107:0/3421332287 wait complete. 2024-05-08T21:00:30.115 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T21:00:30.126 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T21:00:30.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:30.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.232+0000 7f7c469ab700 1 Processor -- start 2024-05-08T21:00:30.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.232+0000 7f7c469ab700 1 -- start start 2024-05-08T21:00:30.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7c400d1200 0x7f7c400d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c400d3a20 con 0x7f7c400d35c0 2024-05-08T21:00:30.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4015d850 con 0x7f7c400d1200 2024-05-08T21:00:30.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400d16d0 con 0x7f7c4015d470 2024-05-08T21:00:30.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c461aa700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7c400d35c0 0x7f7c400cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37332/0 (socket says 172.21.15.107:37332) 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c461aa700 1 -- 172.21.15.107:0/3457008510 learned_addr learned my addr 172.21.15.107:0/3457008510 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c459a9700 1 --2- 172.21.15.107:0/3457008510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c451a8700 1 --2- 172.21.15.107:0/3457008510 >> v2:172.21.15.195:3300/0 conn(0x7f7c400d1200 0x7f7c400d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c449a7700 1 -- 172.21.15.107:0/3457008510 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060294109 0 0) 0x7f7c400d3a20 con 0x7f7c400d35c0 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c449a7700 1 -- 172.21.15.107:0/3457008510 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c2c0035d0 con 0x7f7c400d35c0 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c459a9700 1 -- 172.21.15.107:0/3457008510 >> v2:172.21.15.195:3300/0 conn(0x7f7c400d1200 msgr2=0x7f7c400d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c459a9700 1 --2- 172.21.15.107:0/3457008510 >> v2:172.21.15.195:3300/0 conn(0x7f7c400d1200 0x7f7c400d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c459a9700 1 -- 172.21.15.107:0/3457008510 >> v1:172.21.15.107:6789/0 conn(0x7f7c400d35c0 legacy=0x7f7c400cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c449a7700 1 -- 172.21.15.107:0/3457008510 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084214853 0 0) 0x7f7c2c0035d0 con 0x7f7c400d35c0 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c459a9700 1 -- 172.21.15.107:0/3457008510 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400d19b0 con 0x7f7c4015d470 2024-05-08T21:00:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c451a8700 1 --2- 172.21.15.107:0/3457008510 >> v2:172.21.15.195:3300/0 conn(0x7f7c400d1200 0x7f7c400d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c459a9700 1 --2- 172.21.15.107:0/3457008510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400d0cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009850 tx=0x7f7c30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51790bf27e1be5c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c449a7700 1 -- 172.21.15.107:0/3457008510 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380019f0 con 0x7f7c4015d470 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c449a7700 1 -- 172.21.15.107:0/3457008510 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30004030 con 0x7f7c4015d470 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c449a7700 1 -- 172.21.15.107:0/3457008510 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300043e0 con 0x7f7c4015d470 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- 172.21.15.107:0/3457008510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 msgr2=0x7f7c400d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 --2- 172.21.15.107:0/3457008510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400d0cc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009850 tx=0x7f7c30009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- 172.21.15.107:0/3457008510 shutdown_connections 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 --2- 172.21.15.107:0/3457008510 >> v2:172.21.15.195:3300/0 conn(0x7f7c400d1200 0x7f7c400d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 --2- 172.21.15.107:0/3457008510 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400d0cc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- 172.21.15.107:0/3457008510 >> 172.21.15.107:0/3457008510 conn(0x7f7c4008b000 msgr2=0x7f7c4009c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- 172.21.15.107:0/3457008510 shutdown_connections 2024-05-08T21:00:30.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.236+0000 7f7c469ab700 1 -- 172.21.15.107:0/3457008510 wait complete. 2024-05-08T21:00:30.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 Processor -- start 2024-05-08T21:00:30.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 -- start start 2024-05-08T21:00:30.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c400d1200 0x7f7c40159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c400d35c0 0x7f7c400cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400cb0b0 con 0x7f7c400d35c0 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c40159dc0 con 0x7f7c400d1200 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c400ca1c0 con 0x7f7c4015d470 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c400d35c0 0x7f7c400cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c400d35c0 0x7f7c400cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36408/0 (socket says 172.21.15.107:36408) 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 -- 172.21.15.107:0/1016765919 learned_addr learned my addr 172.21.15.107:0/1016765919 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c459a9700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c400d1200 0x7f7c40159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c461aa700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 -- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 msgr2=0x7f7c400c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7c4015d470 0x7f7c400c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 -- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c400d1200 msgr2=0x7f7c40159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c400d1200 0x7f7c40159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 -- 172.21.15.107:0/1016765919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c0094b0 con 0x7f7c400d35c0 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c451a8700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c400d35c0 0x7f7c400cb540 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e9b0 tx=0x7f7c3c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c00c850 con 0x7f7c400d35c0 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c00c9b0 con 0x7f7c400d35c0 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c00cd60 con 0x7f7c400d35c0 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c300094b0 con 0x7f7c400d35c0 2024-05-08T21:00:30.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.240+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c400ca780 con 0x7f7c400d35c0 2024-05-08T21:00:30.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c400d1f70 con 0x7f7c400d35c0 2024-05-08T21:00:30.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c3c013470 con 0x7f7c400d35c0 2024-05-08T21:00:30.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c367fc700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7c24066730 0x7f7c24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f7c3c084080 con 0x7f7c400d35c0 2024-05-08T21:00:30.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c459a9700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7c24066730 0x7f7c24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c367fc700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f7c2406ebb0 0x7f7c24071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 --> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c24071720 con 0x7f7c2406ebb0 2024-05-08T21:00:30.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c3c086600 con 0x7f7c400d35c0 2024-05-08T21:00:30.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c461aa700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f7c2406ebb0 0x7f7c24071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.244+0000 7f7c459a9700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7c24066730 0x7f7c24068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c300090b0 tx=0x7f7c30008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.248+0000 7f7c461aa700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f7c2406ebb0 0x7f7c24071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.248+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== osd.5 v2:172.21.15.195:6800/26317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7c24071720 con 0x7f7c2406ebb0 2024-05-08T21:00:30.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 --> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7c400684b0 con 0x7f7c2406ebb0 2024-05-08T21:00:30.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c367fc700 1 -- 172.21.15.107:0/1016765919 <== osd.5 v2:172.21.15.195:6800/26317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7c400684b0 con 0x7f7c2406ebb0 2024-05-08T21:00:30.276 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:30.276 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:30.276 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:30.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f7c2406ebb0 msgr2=0x7f7c24071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.195:6800/26317,v1:172.21.15.195:6801/26317] conn(0x7f7c2406ebb0 0x7f7c24071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7c24066730 msgr2=0x7f7c24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f7c24066730 0x7f7c24068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c300090b0 tx=0x7f7c30008030 comp rx=0 tx=0).stop 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c400d35c0 msgr2=0x7f7c400cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 --2- 172.21.15.107:0/1016765919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c400d35c0 0x7f7c400cb540 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00e9b0 tx=0x7f7c3c00ed70 comp rx=0 tx=0).stop 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c461aa700 1 -- 172.21.15.107:0/1016765919 reap_dead start 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 shutdown_connections 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 >> 172.21.15.107:0/1016765919 conn(0x7f7c4008b000 msgr2=0x7f7c400cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 shutdown_connections 2024-05-08T21:00:30.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.268+0000 7f7c469ab700 1 -- 172.21.15.107:0/1016765919 wait complete. 2024-05-08T21:00:30.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T21:00:30.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 Processor -- start 2024-05-08T21:00:30.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 -- start start 2024-05-08T21:00:30.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7538071e70 0x7f75381624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538070110 0x7f75380705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7538158960 con 0x7f75380b3c20 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75380b1f60 con 0x7f7538071e70 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753efe6700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380ae990 con 0x7f7538070110 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753dfe4700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f75380b3c20 0x7f75380b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37334/0 (socket says 172.21.15.107:37334) 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753dfe4700 1 -- 172.21.15.107:0/664650696 learned_addr learned my addr 172.21.15.107:0/664650696 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753e7e5700 1 --2- 172.21.15.107:0/664650696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538070110 0x7f75380705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753d7e3700 1 --2- 172.21.15.107:0/664650696 >> v2:172.21.15.195:3300/0 conn(0x7f7538071e70 0x7f75381624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753cfe2700 1 -- 172.21.15.107:0/664650696 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617192397 0 0) 0x7f7538158960 con 0x7f75380b3c20 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753cfe2700 1 -- 172.21.15.107:0/664650696 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75240035d0 con 0x7f75380b3c20 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753e7e5700 1 -- 172.21.15.107:0/664650696 >> v2:172.21.15.195:3300/0 conn(0x7f7538071e70 msgr2=0x7f75381624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753e7e5700 1 --2- 172.21.15.107:0/664650696 >> v2:172.21.15.195:3300/0 conn(0x7f7538071e70 0x7f75381624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753e7e5700 1 -- 172.21.15.107:0/664650696 >> v1:172.21.15.107:6789/0 conn(0x7f75380b3c20 legacy=0x7f75380b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753e7e5700 1 -- 172.21.15.107:0/664650696 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75380b2170 con 0x7f7538070110 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753e7e5700 1 --2- 172.21.15.107:0/664650696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538070110 0x7f75380705a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7530009d90 tx=0x7f753000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad3b91b98ee39dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753cfe2700 1 -- 172.21.15.107:0/664650696 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000e070 con 0x7f7538070110 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753cfe2700 1 -- 172.21.15.107:0/664650696 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000bb20 con 0x7f7538070110 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.400+0000 7f753cfe2700 1 -- 172.21.15.107:0/664650696 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000be90 con 0x7f7538070110 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 -- 172.21.15.107:0/664650696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538070110 msgr2=0x7f75380705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 --2- 172.21.15.107:0/664650696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538070110 0x7f75380705a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7530009d90 tx=0x7f753000b330 comp rx=0 tx=0).stop 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 -- 172.21.15.107:0/664650696 shutdown_connections 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 --2- 172.21.15.107:0/664650696 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538070110 0x7f75380705a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 --2- 172.21.15.107:0/664650696 >> v2:172.21.15.195:3300/0 conn(0x7f7538071e70 0x7f75381624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 -- 172.21.15.107:0/664650696 >> 172.21.15.107:0/664650696 conn(0x7f753806c330 msgr2=0x7f753806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 -- 172.21.15.107:0/664650696 shutdown_connections 2024-05-08T21:00:30.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.404+0000 7f753efe6700 1 -- 172.21.15.107:0/664650696 wait complete. 2024-05-08T21:00:30.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 Processor -- start 2024-05-08T21:00:30.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- start start 2024-05-08T21:00:30.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 0x7f7538150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538071e70 0x7f7538151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75380b3c20 0x7f75380aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75381531d0 con 0x7f7538070110 2024-05-08T21:00:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75380ada70 con 0x7f75380b3c20 2024-05-08T21:00:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380add50 con 0x7f7538071e70 2024-05-08T21:00:30.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 0x7f7538150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 0x7f7538150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36414/0 (socket says 172.21.15.107:36414) 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 -- 172.21.15.107:0/1488752045 learned_addr learned my addr 172.21.15.107:0/1488752045 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753d7e3700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538071e70 0x7f7538151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753e7e5700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75380b3c20 0x7f75380aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 -- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538071e70 msgr2=0x7f7538151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538071e70 0x7f7538151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 -- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75380b3c20 msgr2=0x7f75380aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75380b3c20 0x7f75380aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 -- 172.21.15.107:0/1488752045 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530009a70 con 0x7f7538070110 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753dfe4700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 0x7f7538150cf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f752800c4d0 tx=0x7f752800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7528005d90 con 0x7f7538070110 2024-05-08T21:00:30.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752800ce80 con 0x7f7538070110 2024-05-08T21:00:30.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75380ae030 con 0x7f7538070110 2024-05-08T21:00:30.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75280072d0 con 0x7f7538070110 2024-05-08T21:00:30.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75380ae310 con 0x7f7538070110 2024-05-08T21:00:30.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.408+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75381533a0 con 0x7f7538070110 2024-05-08T21:00:30.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.412+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7528007430 con 0x7f7538070110 2024-05-08T21:00:30.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.412+0000 7f752e7fc700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f751c066730 0x7f751c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.412+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f7528083460 con 0x7f7538070110 2024-05-08T21:00:30.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.412+0000 7f753d7e3700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f751c066730 0x7f751c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.412+0000 7f753d7e3700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f751c066730 0x7f751c068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f75381620d0 tx=0x7f7534009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.420+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f75280507b0 con 0x7f7538070110 2024-05-08T21:00:30.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.584+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f75380b2fa0 con 0x7f751c066730 2024-05-08T21:00:30.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f752e7fc700 1 -- 172.21.15.107:0/1488752045 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f75380b2fa0 con 0x7f751c066730 2024-05-08T21:00:30.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f751c066730 msgr2=0x7f751c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f751c066730 0x7f751c068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f75381620d0 tx=0x7f7534009240 comp rx=0 tx=0).stop 2024-05-08T21:00:30.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 msgr2=0x7f7538150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 0x7f7538150cf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f752800c4d0 tx=0x7f752800c7e0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 shutdown_connections 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f75380b3c20 0x7f75380aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f751c066730 0x7f751c068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7538071e70 0x7f7538151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 --2- 172.21.15.107:0/1488752045 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7538070110 0x7f7538150cf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 >> 172.21.15.107:0/1488752045 conn(0x7f753806c330 msgr2=0x7f75380cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 shutdown_connections 2024-05-08T21:00:30.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.588+0000 7f753efe6700 1 -- 172.21.15.107:0/1488752045 wait complete. 2024-05-08T21:00:30.600 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T21:00:30.611 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T21:00:30.611 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:30.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.720+0000 7f318a9b5700 1 Processor -- start 2024-05-08T21:00:30.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.720+0000 7f318a9b5700 1 -- start start 2024-05-08T21:00:30.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 0x7f31840d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318415d850 con 0x7f31840d1200 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31840d16d0 con 0x7f318415d470 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31840d19b0 con 0x7f31840d3790 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31899b3700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 0x7f31840d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a1b4700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31891b2700 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f31840d1200 0x7f31840d3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.107:42980/0 (socket says 172.21.15.107:42980) 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31899b3700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 0x7f31840d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36416/0 (socket says 172.21.15.107:36416) 2024-05-08T21:00:30.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31891b2700 1 -- 172.21.15.107:0/1246991067 learned_addr learned my addr 172.21.15.107:0/1246991067 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a1b4700 1 -- 172.21.15.107:0/1246991067 >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 msgr2=0x7f31840d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a1b4700 1 --2- 172.21.15.107:0/1246991067 >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 0x7f31840d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a1b4700 1 -- 172.21.15.107:0/1246991067 >> v1:172.21.15.195:6789/0 conn(0x7f31840d1200 legacy=0x7f31840d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a1b4700 1 -- 172.21.15.107:0/1246991067 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840d1c90 con 0x7f31840d3790 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31899b3700 1 --2- 172.21.15.107:0/1246991067 >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 0x7f31840d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31889b1700 1 -- 172.21.15.107:0/1246991067 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322846207 0 0) 0x7f318415d850 con 0x7f31840d1200 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a1b4700 1 --2- 172.21.15.107:0/1246991067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840ce2b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f317c009d90 tx=0x7f317c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acc944b6f06e40f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31889b1700 1 -- 172.21.15.107:0/1246991067 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00e070 con 0x7f31840d3790 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31889b1700 1 -- 172.21.15.107:0/1246991067 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c00bb20 con 0x7f31840d3790 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f31889b1700 1 -- 172.21.15.107:0/1246991067 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c012430 con 0x7f31840d3790 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- 172.21.15.107:0/1246991067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 msgr2=0x7f31840ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 --2- 172.21.15.107:0/1246991067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840ce2b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f317c009d90 tx=0x7f317c00b330 comp rx=0 tx=0).stop 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- 172.21.15.107:0/1246991067 shutdown_connections 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 --2- 172.21.15.107:0/1246991067 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840ce2b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 --2- 172.21.15.107:0/1246991067 >> v2:172.21.15.107:3300/0 conn(0x7f318415d470 0x7f31840d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- 172.21.15.107:0/1246991067 >> 172.21.15.107:0/1246991067 conn(0x7f318408b000 msgr2=0x7f318409c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- 172.21.15.107:0/1246991067 shutdown_connections 2024-05-08T21:00:30.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.724+0000 7f318a9b5700 1 -- 172.21.15.107:0/1246991067 wait complete. 2024-05-08T21:00:30.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 Processor -- start 2024-05-08T21:00:30.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 -- start start 2024-05-08T21:00:30.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31840d1200 0x7f31840b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f318415d470 0x7f31840c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841f35d0 con 0x7f318415d470 2024-05-08T21:00:30.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31840b0b70 con 0x7f31840d1200 2024-05-08T21:00:30.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31841f2c30 con 0x7f31840d3790 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f318415d470 0x7f31840c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f31891b2700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f318415d470 0x7f31840c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36422/0 (socket says 172.21.15.107:36422) 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 -- 172.21.15.107:0/3625053982 learned_addr learned my addr 172.21.15.107:0/3625053982 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f31899b3700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31840d1200 0x7f31840b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 -- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 msgr2=0x7f31840c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f31840d3790 0x7f31840c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 -- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31840d1200 msgr2=0x7f31840b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31840d1200 0x7f31840b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 -- 172.21.15.107:0/3625053982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31740094b0 con 0x7f318415d470 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f31899b3700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31840d1200 0x7f31840b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:30.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a1b4700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f318415d470 0x7f31840c8880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f31840d1af0 tx=0x7f317c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c012430 con 0x7f318415d470 2024-05-08T21:00:30.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c009a70 con 0x7f318415d470 2024-05-08T21:00:30.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c020070 con 0x7f318415d470 2024-05-08T21:00:30.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c004280 con 0x7f318415d470 2024-05-08T21:00:30.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.728+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31841f31f0 con 0x7f318415d470 2024-05-08T21:00:30.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31840cdc90 con 0x7f318415d470 2024-05-08T21:00:30.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f317c0043e0 con 0x7f318415d470 2024-05-08T21:00:30.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f317a7fc700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3168066730 0x7f3168068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f317c022070 con 0x7f318415d470 2024-05-08T21:00:30.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f317a7fc700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7f316806ebb0 0x7f3168071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 --> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3168071720 con 0x7f316806ebb0 2024-05-08T21:00:30.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f31899b3700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3168066730 0x7f3168068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f317c086810 con 0x7f318415d470 2024-05-08T21:00:30.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f31891b2700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7f316806ebb0 0x7f3168071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f31899b3700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3168066730 0x7f3168068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3174009dd0 tx=0x7f3174008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.732+0000 7f31891b2700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7f316806ebb0 0x7f3168071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.736+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== osd.6 v2:172.21.15.195:6816/26318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3168071720 con 0x7f316806ebb0 2024-05-08T21:00:30.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.748+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 --> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31841f3710 con 0x7f316806ebb0 2024-05-08T21:00:30.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f317a7fc700 1 -- 172.21.15.107:0/3625053982 <== osd.6 v2:172.21.15.195:6816/26318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f31841f3710 con 0x7f316806ebb0 2024-05-08T21:00:30.759 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:30.760 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:30.760 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:30.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7f316806ebb0 msgr2=0x7f3168071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.195:6816/26318,v1:172.21.15.195:6817/26318] conn(0x7f316806ebb0 0x7f3168071050 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3168066730 msgr2=0x7f3168068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f3168066730 0x7f3168068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3174009dd0 tx=0x7f3174008040 comp rx=0 tx=0).stop 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f318415d470 msgr2=0x7f31840c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 --2- 172.21.15.107:0/3625053982 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f318415d470 0x7f31840c8880 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f31840d1af0 tx=0x7f317c004af0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a1b4700 1 -- 172.21.15.107:0/3625053982 reap_dead start 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 shutdown_connections 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 >> 172.21.15.107:0/3625053982 conn(0x7f318408b000 msgr2=0x7f31841600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 shutdown_connections 2024-05-08T21:00:30.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.752+0000 7f318a9b5700 1 -- 172.21.15.107:0/3625053982 wait complete. 2024-05-08T21:00:30.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T21:00:30.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 Processor -- start 2024-05-08T21:00:30.901 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 -- start start 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe6bc0df8b0 0x7fe6bc055dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6bc036750 0x7fe6bc04faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc03a150 0x7fe6bc03a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc03aaa0 con 0x7fe6bc036750 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6bc006ce0 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cb48c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc006fc0 con 0x7fe6bc03a150 2024-05-08T21:00:30.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6bc036750 0x7fe6bc04faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe6bc036750 0x7fe6bc04faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36432/0 (socket says 172.21.15.107:36432) 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 -- 172.21.15.107:0/169591622 learned_addr learned my addr 172.21.15.107:0/169591622 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6cac8b700 1 --2- 172.21.15.107:0/169591622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc03a150 0x7fe6bc03a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6ca48a700 1 --2- 172.21.15.107:0/169591622 >> v2:172.21.15.195:3300/0 conn(0x7fe6bc0df8b0 0x7fe6bc055dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 -- 172.21.15.107:0/169591622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc03a150 msgr2=0x7fe6bc03a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 --2- 172.21.15.107:0/169591622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc03a150 0x7fe6bc03a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 -- 172.21.15.107:0/169591622 >> v2:172.21.15.195:3300/0 conn(0x7fe6bc0df8b0 msgr2=0x7fe6bc055dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:30.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 --2- 172.21.15.107:0/169591622 >> v2:172.21.15.195:3300/0 conn(0x7fe6bc0df8b0 0x7fe6bc055dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6c9c89700 1 -- 172.21.15.107:0/169591622 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc0072a0 con 0x7fe6bc036750 2024-05-08T21:00:30.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.892+0000 7fe6ca48a700 1 --2- 172.21.15.107:0/169591622 >> v2:172.21.15.195:3300/0 conn(0x7fe6bc0df8b0 0x7fe6bc055dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:30.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6c9c89700 1 --2- 172.21.15.107:0/169591622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc036750 0x7fe6bc04faf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00dd10 tx=0x7fe6c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399a24d58768a499 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6c9488700 1 -- 172.21.15.107:0/169591622 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0011830 con 0x7fe6bc036750 2024-05-08T21:00:30.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6c9488700 1 -- 172.21.15.107:0/169591622 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0011990 con 0x7fe6bc036750 2024-05-08T21:00:30.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6c9488700 1 -- 172.21.15.107:0/169591622 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0011d20 con 0x7fe6bc036750 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 -- 172.21.15.107:0/169591622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc036750 msgr2=0x7fe6bc04faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/169591622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc036750 0x7fe6bc04faf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00dd10 tx=0x7fe6c0009bf0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 -- 172.21.15.107:0/169591622 shutdown_connections 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/169591622 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc03a150 0x7fe6bc03a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/169591622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc036750 0x7fe6bc04faf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/169591622 >> v2:172.21.15.195:3300/0 conn(0x7fe6bc0df8b0 0x7fe6bc055dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 -- 172.21.15.107:0/169591622 >> 172.21.15.107:0/169591622 conn(0x7fe6bc01e770 msgr2=0x7fe6bc0554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 -- 172.21.15.107:0/169591622 shutdown_connections 2024-05-08T21:00:30.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 -- 172.21.15.107:0/169591622 wait complete. 2024-05-08T21:00:30.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 Processor -- start 2024-05-08T21:00:30.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.896+0000 7fe6cb48c700 1 -- start start 2024-05-08T21:00:30.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc036750 0x7fe6bc006360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc03a150 0x7fe6bc0332a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 0x7fe6bc0d4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc032e10 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc032200 con 0x7fe6bc03a150 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc0324e0 con 0x7fe6bc036750 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 0x7fe6bc0d4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 0x7fe6bc0d4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36438/0 (socket says 172.21.15.107:36438) 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 -- 172.21.15.107:0/1346118061 learned_addr learned my addr 172.21.15.107:0/1346118061 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6c9c89700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc03a150 0x7fe6bc0332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6ca48a700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc036750 0x7fe6bc006360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 -- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc036750 msgr2=0x7fe6bc006360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc036750 0x7fe6bc006360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 -- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc03a150 msgr2=0x7fe6bc0332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:30.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc03a150 0x7fe6bc0332a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 -- 172.21.15.107:0/1346118061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009570 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6ca48a700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc036750 0x7fe6bc006360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6c9c89700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc03a150 0x7fe6bc0332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cac8b700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 0x7fe6bc0d4190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe6c404ffd0 tx=0x7fe6c4067c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4072690 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40727f0 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc0327c0 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c406d460 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.900+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc0d2680 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.904+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe6c406d7d0 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.904+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6bc005890 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.904+0000 7fe6b6ffd700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe6a8066730 0x7fe6a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:30.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.904+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fe6c4090070 con 0x7fe6bc0df8b0 2024-05-08T21:00:30.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.904+0000 7fe6ca48a700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe6a8066730 0x7fe6a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:30.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.904+0000 7fe6ca48a700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe6a8066730 0x7fe6a8068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0eb510 tx=0x7fe6b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:30.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:30.912+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe6c40cbd80 con 0x7fe6bc0df8b0 2024-05-08T21:00:31.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6bc0dfc90 con 0x7fe6a8066730 2024-05-08T21:00:31.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6b6ffd700 1 -- 172.21.15.107:0/1346118061 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe6b800ce40 con 0x7fe6a8066730 2024-05-08T21:00:31.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe6a8066730 msgr2=0x7fe6a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe6a8066730 0x7fe6a8068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc0eb510 tx=0x7fe6b8008040 comp rx=0 tx=0).stop 2024-05-08T21:00:31.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 msgr2=0x7fe6bc0d4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 0x7fe6bc0d4190 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe6c404ffd0 tx=0x7fe6c4067c90 comp rx=0 tx=0).stop 2024-05-08T21:00:31.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 shutdown_connections 2024-05-08T21:00:31.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe6bc0df8b0 0x7fe6bc0d4190 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe6bc03a150 0x7fe6bc0332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe6a8066730 0x7fe6a8068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 --2- 172.21.15.107:0/1346118061 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe6bc036750 0x7fe6bc006360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 >> 172.21.15.107:0/1346118061 conn(0x7fe6bc01e770 msgr2=0x7fe6bc050d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 shutdown_connections 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.084+0000 7fe6cb48c700 1 -- 172.21.15.107:0/1346118061 wait complete. 2024-05-08T21:00:31.095 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T21:00:31.106 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T21:00:31.106 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T21:00:31.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.216+0000 7f5df2284700 1 Processor -- start 2024-05-08T21:00:31.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.216+0000 7f5df2284700 1 -- start start 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5dec15d330 0x7f5dec06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec06f9e0 0x7f5dec06a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec15d710 con 0x7f5dec06a8a0 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec06ad50 con 0x7f5dec15d330 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0b33a0 con 0x7f5dec06f9e0 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df0821700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5dec06a8a0 0x7f5dec0712c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37340/0 (socket says 172.21.15.107:37340) 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df0821700 1 -- 172.21.15.107:0/1244499542 learned_addr learned my addr 172.21.15.107:0/1244499542 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:31.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5debfff700 1 --2- 172.21.15.107:0/1244499542 >> v2:172.21.15.107:3300/0 conn(0x7f5dec15d330 0x7f5dec06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5deb7fe700 1 --2- 172.21.15.107:0/1244499542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec06f9e0 0x7f5dec06a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5deaffd700 1 -- 172.21.15.107:0/1244499542 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048934433 0 0) 0x7f5de4001490 con 0x7f5dec06a8a0 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5deaffd700 1 -- 172.21.15.107:0/1244499542 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd80035d0 con 0x7f5dec06a8a0 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5debfff700 1 -- 172.21.15.107:0/1244499542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec06f9e0 msgr2=0x7f5dec06a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5debfff700 1 --2- 172.21.15.107:0/1244499542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec06f9e0 0x7f5dec06a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5debfff700 1 -- 172.21.15.107:0/1244499542 >> v1:172.21.15.107:6789/0 conn(0x7f5dec06a8a0 legacy=0x7f5dec0712c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5debfff700 1 -- 172.21.15.107:0/1244499542 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0b3680 con 0x7f5dec15d330 2024-05-08T21:00:31.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5debfff700 1 --2- 172.21.15.107:0/1244499542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec15d330 0x7f5dec06eab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009850 tx=0x7f5ddc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d060925226cda7ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5deaffd700 1 -- 172.21.15.107:0/1244499542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011830 con 0x7f5dec15d330 2024-05-08T21:00:31.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5deaffd700 1 -- 172.21.15.107:0/1244499542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc011990 con 0x7f5dec15d330 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5deaffd700 1 -- 172.21.15.107:0/1244499542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011d40 con 0x7f5dec15d330 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- 172.21.15.107:0/1244499542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec15d330 msgr2=0x7f5dec06eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 --2- 172.21.15.107:0/1244499542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec15d330 0x7f5dec06eab0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009850 tx=0x7f5ddc009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- 172.21.15.107:0/1244499542 shutdown_connections 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 --2- 172.21.15.107:0/1244499542 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec06f9e0 0x7f5dec06a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 --2- 172.21.15.107:0/1244499542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec15d330 0x7f5dec06eab0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- 172.21.15.107:0/1244499542 >> 172.21.15.107:0/1244499542 conn(0x7f5dec06d520 msgr2=0x7f5dec06d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- 172.21.15.107:0/1244499542 shutdown_connections 2024-05-08T21:00:31.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.220+0000 7f5df2284700 1 -- 172.21.15.107:0/1244499542 wait complete. 2024-05-08T21:00:31.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 Processor -- start 2024-05-08T21:00:31.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 -- start start 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec06a8a0 0x7f5dec153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec06f9e0 0x7f5dec1f3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec15d330 0x7f5dec0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1f3b90 con 0x7f5dec06f9e0 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1f3e50 con 0x7f5dec06a8a0 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df2284700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1f4130 con 0x7f5dec15d330 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec06f9e0 0x7f5dec1f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec06f9e0 0x7f5dec1f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36448/0 (socket says 172.21.15.107:36448) 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 -- 172.21.15.107:0/1393450527 learned_addr learned my addr 172.21.15.107:0/1393450527 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5debfff700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec06a8a0 0x7f5dec153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5df0821700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec15d330 0x7f5dec0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 -- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec15d330 msgr2=0x7f5dec0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5dec15d330 0x7f5dec0b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 -- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec06a8a0 msgr2=0x7f5dec153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5dec06a8a0 0x7f5dec153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 -- 172.21.15.107:0/1393450527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0094b0 con 0x7f5dec06f9e0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.224+0000 7f5deb7fe700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec06f9e0 0x7f5dec1f3360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400e9a0 tx=0x7f5dd400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4009720 con 0x7f5dec06f9e0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400c690 con 0x7f5dec06f9e0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec1f4410 con 0x7f5dec06f9e0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400ca20 con 0x7f5dec06f9e0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec1f38a0 con 0x7f5dec06f9e0 2024-05-08T21:00:31.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5dec1f3fc0 con 0x7f5dec06f9e0 2024-05-08T21:00:31.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5dd400cb80 con 0x7f5dec06f9e0 2024-05-08T21:00:31.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5de8ff9700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5dcc066730 0x7f5dcc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f5dd40845f0 con 0x7f5dec06f9e0 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.228+0000 7f5debfff700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5dcc066730 0x7f5dcc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5de8ff9700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7f5dcc06ebb0 0x7f5dcc071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 --> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dcc071720 con 0x7f5dcc06ebb0 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dd4084960 con 0x7f5dec06f9e0 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5df0821700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7f5dcc06ebb0 0x7f5dcc071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5debfff700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5dcc066730 0x7f5dcc068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0090b0 tx=0x7f5ddc01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5df0821700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7f5dcc06ebb0 0x7f5dcc071050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.232+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== osd.7 v2:172.21.15.195:6824/26320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5dcc071720 con 0x7f5dcc06ebb0 2024-05-08T21:00:31.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 --> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5dec0b3f20 con 0x7f5dcc06ebb0 2024-05-08T21:00:31.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5de8ff9700 1 -- 172.21.15.107:0/1393450527 <== osd.7 v2:172.21.15.195:6824/26320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5de4001fd0 con 0x7f5dcc06ebb0 2024-05-08T21:00:31.260 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-08T21:00:31.260 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T21:00:31.260 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7f5dcc06ebb0 msgr2=0x7f5dcc071050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.195:6824/26320,v1:172.21.15.195:6825/26320] conn(0x7f5dcc06ebb0 0x7f5dcc071050 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5dcc066730 msgr2=0x7f5dcc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5dcc066730 0x7f5dcc068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0090b0 tx=0x7f5ddc01c040 comp rx=0 tx=0).stop 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec06f9e0 msgr2=0x7f5dec1f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 --2- 172.21.15.107:0/1393450527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5dec06f9e0 0x7f5dec1f3360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400e9a0 tx=0x7f5dd400ecb0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df0821700 1 -- 172.21.15.107:0/1393450527 reap_dead start 2024-05-08T21:00:31.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 shutdown_connections 2024-05-08T21:00:31.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 >> 172.21.15.107:0/1393450527 conn(0x7f5dec06d520 msgr2=0x7f5dec15ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 shutdown_connections 2024-05-08T21:00:31.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.252+0000 7f5df2284700 1 -- 172.21.15.107:0/1393450527 wait complete. 2024-05-08T21:00:31.273 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T21:00:31.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.384+0000 7fba4134a700 1 Processor -- start 2024-05-08T21:00:31.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.384+0000 7fba4134a700 1 -- start start 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c15aed0 0x7fba3c0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fba3c0cb970 0x7fba3c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3c0cd470 con 0x7fba3c0b2e40 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba3c0ced50 con 0x7fba3c0cb970 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c0cceb0 con 0x7fba3c15aed0 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3b7fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fba3c0b2e40 0x7fba3c06c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37342/0 (socket says 172.21.15.107:37342) 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3b7fe700 1 -- 172.21.15.107:0/3692317054 learned_addr learned my addr 172.21.15.107:0/3692317054 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3a7fc700 1 --2- 172.21.15.107:0/3692317054 >> v2:172.21.15.195:3300/0 conn(0x7fba3c0cb970 0x7fba3c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3affd700 1 --2- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c15aed0 0x7fba3c0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba39ffb700 1 -- 172.21.15.107:0/3692317054 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462225687 0 0) 0x7fba3c0cd470 con 0x7fba3c0b2e40 2024-05-08T21:00:31.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba39ffb700 1 -- 172.21.15.107:0/3692317054 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba240035d0 con 0x7fba3c0b2e40 2024-05-08T21:00:31.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3a7fc700 1 -- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c15aed0 msgr2=0x7fba3c0cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:31.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3a7fc700 1 --2- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c15aed0 0x7fba3c0cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3a7fc700 1 -- 172.21.15.107:0/3692317054 >> v1:172.21.15.107:6789/0 conn(0x7fba3c0b2e40 legacy=0x7fba3c06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3a7fc700 1 -- 172.21.15.107:0/3692317054 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0cd190 con 0x7fba3c0cb970 2024-05-08T21:00:31.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba3a7fc700 1 --2- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c0b2900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009850 tx=0x7fba2c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c185f8877eea84aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba39ffb700 1 -- 172.21.15.107:0/3692317054 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c011830 con 0x7fba3c0cb970 2024-05-08T21:00:31.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba39ffb700 1 -- 172.21.15.107:0/3692317054 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c011990 con 0x7fba3c0cb970 2024-05-08T21:00:31.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba39ffb700 1 -- 172.21.15.107:0/3692317054 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c011d40 con 0x7fba3c0cb970 2024-05-08T21:00:31.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 msgr2=0x7fba3c0b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 --2- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c0b2900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009850 tx=0x7fba2c009b60 comp rx=0 tx=0).stop 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- 172.21.15.107:0/3692317054 shutdown_connections 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 --2- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c0b2900 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 --2- 172.21.15.107:0/3692317054 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c15aed0 0x7fba3c0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- 172.21.15.107:0/3692317054 >> 172.21.15.107:0/3692317054 conn(0x7fba3c06a360 msgr2=0x7fba3c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- 172.21.15.107:0/3692317054 shutdown_connections 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.388+0000 7fba4134a700 1 -- 172.21.15.107:0/3692317054 wait complete. 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 Processor -- start 2024-05-08T21:00:31.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 -- start start 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c0b2e40 0x7fba3c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 0x7fba3c1f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c154f80 con 0x7fba3c15aed0 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c14c6f0 con 0x7fba3c0cb970 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c155200 con 0x7fba3c0b2e40 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 0x7fba3c1f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 0x7fba3c1f08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36458/0 (socket says 172.21.15.107:36458) 2024-05-08T21:00:31.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3b7fe700 1 -- 172.21.15.107:0/1503783946 learned_addr learned my addr 172.21.15.107:0/1503783946 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:31.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c0b2e40 0x7fba3c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3a7fc700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 -- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 msgr2=0x7fba3c14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c14ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 -- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 msgr2=0x7fba3c1f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 0x7fba3c1f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 -- 172.21.15.107:0/1503783946 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0094b0 con 0x7fba3c0b2e40 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3b7fe700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 0x7fba3c1f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba3affd700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c0b2e40 0x7fba3c149510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba3000e870 tx=0x7fba3000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30013680 con 0x7fba3c0b2e40 2024-05-08T21:00:31.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300137e0 con 0x7fba3c0b2e40 2024-05-08T21:00:31.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c14d390 con 0x7fba3c0b2e40 2024-05-08T21:00:31.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.392+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30013b70 con 0x7fba3c0b2e40 2024-05-08T21:00:31.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.396+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3c1f0e40 con 0x7fba3c0b2e40 2024-05-08T21:00:31.404 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.396+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3c0684b0 con 0x7fba3c0b2e40 2024-05-08T21:00:31.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.396+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba30013cd0 con 0x7fba3c0b2e40 2024-05-08T21:00:31.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.400+0000 7fba237fe700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fba28066760 0x7fba28068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.400+0000 7fba3a7fc700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fba28066760 0x7fba28068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.400+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fba30084450 con 0x7fba3c0b2e40 2024-05-08T21:00:31.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.400+0000 7fba3a7fc700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fba28066760 0x7fba28068c20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0090b0 tx=0x7fba2c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.408+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fba30051780 con 0x7fba3c0b2e40 2024-05-08T21:00:31.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.576+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fba3c0b23e0 con 0x7fba28066760 2024-05-08T21:00:31.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.576+0000 7fba237fe700 1 -- 172.21.15.107:0/1503783946 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fba2c011b00 con 0x7fba28066760 2024-05-08T21:00:31.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fba28066760 msgr2=0x7fba28068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fba28066760 0x7fba28068c20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0090b0 tx=0x7fba2c008030 comp rx=0 tx=0).stop 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c0b2e40 msgr2=0x7fba3c149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c0b2e40 0x7fba3c149510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba3000e870 tx=0x7fba3000eb80 comp rx=0 tx=0).stop 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 shutdown_connections 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba3c15aed0 0x7fba3c1f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba3c0cb970 0x7fba3c14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fba28066760 0x7fba28068c20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 --2- 172.21.15.107:0/1503783946 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fba3c0b2e40 0x7fba3c149510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 >> 172.21.15.107:0/1503783946 conn(0x7fba3c06a360 msgr2=0x7fba3c157910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 shutdown_connections 2024-05-08T21:00:31.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.580+0000 7fba4134a700 1 -- 172.21.15.107:0/1503783946 wait complete. 2024-05-08T21:00:31.592 INFO:teuthology.orchestra.run.smithi107.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T21:00:31.604 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:00:31.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0bc95a700 1 Processor -- start 2024-05-08T21:00:31.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0bc95a700 1 -- start start 2024-05-08T21:00:31.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0bc95a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 0x7fa0b80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0bc95a700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80cef80 con 0x7fa0b815e6d0 2024-05-08T21:00:31.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0bc95a700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80cdd00 con 0x7fa0b80d0b90 2024-05-08T21:00:31.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0bc95a700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815eb20 con 0x7fa0b80ceb40 2024-05-08T21:00:31.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0b77fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa0b815e6d0 0x7fa0b815f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:37352/0 (socket says 172.21.15.107:37352) 2024-05-08T21:00:31.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0b77fe700 1 -- 172.21.15.107:0/146888649 learned_addr learned my addr 172.21.15.107:0/146888649 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:31.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 0x7fa0b80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897518758 0 0) 0x7fa0ac001110 con 0x7fa0b815e6d0 2024-05-08T21:00:31.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.704+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a00035d0 con 0x7fa0b815e6d0 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 115896258 0 0) 0x7fa0a00035d0 con 0x7fa0b815e6d0 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 msgr2=0x7fa0b80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 0x7fa0b80cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 >> v1:172.21.15.195:6789/0 conn(0x7fa0b80d0b90 legacy=0x7fa0b80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b815f9f0 con 0x7fa0b815e6d0 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7fa0ac001800 con 0x7fa0b815e6d0 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 >> v1:172.21.15.107:6789/0 conn(0x7fa0b815e6d0 legacy=0x7fa0b815f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 0x7fa0a0003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0a0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a0004db0 0x7fa0a0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815eb20 con 0x7fa0a0003fb0 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a000bae0 con 0x7fa0a0004db0 2024-05-08T21:00:31.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a000bc70 con 0x7fa0b80ceb40 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0a0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b7fff700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a0004db0 0x7fa0a0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 0x7fa0a0003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 -- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 msgr2=0x7fa0a0003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b80ceb40 0x7fa0a0003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 -- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a0004db0 msgr2=0x7fa0a0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0a0004db0 0x7fa0a0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 -- 172.21.15.107:0/146888649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00035d0 con 0x7fa0a0003fb0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0a0004870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009ba0 tx=0x7fa0a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51c556f79ec1b68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800e6c0 con 0x7fa0a0003fb0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a800e820 con 0x7fa0a0003fb0 2024-05-08T21:00:31.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b67fc700 1 -- 172.21.15.107:0/146888649 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800eb90 con 0x7fa0a0003fb0 2024-05-08T21:00:31.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0bc95a700 1 -- 172.21.15.107:0/146888649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 msgr2=0x7fa0a0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/146888649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0a0004870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009ba0 tx=0x7fa0a00058a0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0b7fff700 1 -- 172.21.15.107:0/146888649 reap_dead start 2024-05-08T21:00:31.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0bc95a700 1 -- 172.21.15.107:0/146888649 shutdown_connections 2024-05-08T21:00:31.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0bc95a700 1 -- 172.21.15.107:0/146888649 >> 172.21.15.107:0/146888649 conn(0x7fa0b8099a70 msgr2=0x7fa0b8099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0bc95a700 1 -- 172.21.15.107:0/146888649 shutdown_connections 2024-05-08T21:00:31.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.708+0000 7fa0bc95a700 1 -- 172.21.15.107:0/146888649 wait complete. 2024-05-08T21:00:31.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 Processor -- start 2024-05-08T21:00:31.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 -- start start 2024-05-08T21:00:31.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0b8154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 0x7fa0b815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b8159090 0x7fa0b8159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8159a50 con 0x7fa0a0003fb0 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815c200 con 0x7fa0b815d2c0 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815c4a0 con 0x7fa0b8159090 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0b8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 0x7fa0b815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 0x7fa0b815bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.107:39306/0 (socket says 172.21.15.107:39306) 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b7fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b8159090 0x7fa0b8159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b6ffd700 1 -- 172.21.15.107:0/3303543621 learned_addr learned my addr 172.21.15.107:0/3303543621 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:31.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 -- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b8159090 msgr2=0x7fa0b8159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b8159090 0x7fa0b8159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 -- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 msgr2=0x7fa0b815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 0x7fa0b815bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 -- 172.21.15.107:0/3303543621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b815c780 con 0x7fa0a0003fb0 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 0x7fa0b815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0b77fe700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0b8154510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e830 tx=0x7fa0ac00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac012590 con 0x7fa0a0003fb0 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac012710 con 0x7fa0a0003fb0 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b815ca60 con 0x7fa0a0003fb0 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac012ac0 con 0x7fa0a0003fb0 2024-05-08T21:00:31.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.712+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b80b4460 con 0x7fa0a0003fb0 2024-05-08T21:00:31.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.716+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b80684b0 con 0x7fa0a0003fb0 2024-05-08T21:00:31.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.716+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa0ac012c20 con 0x7fa0a0003fb0 2024-05-08T21:00:31.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.716+0000 7fa09ffff700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0a4066760 0x7fa0a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:31.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.716+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fa0ac083d30 con 0x7fa0a0003fb0 2024-05-08T21:00:31.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.716+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0a4066760 0x7fa0a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:31.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.720+0000 7fa0b6ffd700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0a4066760 0x7fa0a4068c20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800a010 tx=0x7fa0a801e040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:31.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.724+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa0ac050fe0 con 0x7fa0a0003fb0 2024-05-08T21:00:31.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.888+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0b80ce520 con 0x7fa0a4066760 2024-05-08T21:00:31.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.904+0000 7fa09ffff700 1 -- 172.21.15.107:0/3303543621 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286895 (secure 0 0 0) 0x7fa0a8004040 con 0x7fa0a4066760 2024-05-08T21:00:31.917 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0a4066760 msgr2=0x7fa0a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0a4066760 0x7fa0a4068c20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800a010 tx=0x7fa0a801e040 comp rx=0 tx=0).stop 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 msgr2=0x7fa0b8154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0b8154510 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00e830 tx=0x7fa0ac00eb40 comp rx=0 tx=0).stop 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 shutdown_connections 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa0a4066760 0x7fa0a4068c20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa0b8159090 0x7fa0b8159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0b815d2c0 0x7fa0b815bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 --2- 172.21.15.107:0/3303543621 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa0a0003fb0 0x7fa0b8154510 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:31.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.908+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 >> 172.21.15.107:0/3303543621 conn(0x7fa0b8099a70 msgr2=0x7fa0b806f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:31.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.912+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 shutdown_connections 2024-05-08T21:00:31.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:31.912+0000 7fa0bc95a700 1 -- 172.21.15.107:0/3303543621 wait complete. 2024-05-08T21:00:31.920 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:00:31.933 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-05-08T21:00:30.776168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681242,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3273,"num_write_kb":33978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7245,"ondisk_log_size":7245,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003917"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442882+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T21:00:02.442882+0000","last_peered":"2024-05-08T21:00:02.442882+0000","last_clean":"2024-05-08T21:00:02.442882+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:00:02.442882+0000","last_undegraded":"2024-05-08T21:00:02.442882+0000","last_fullsized":"2024-05-08T21:00:02.442882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:10.222778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438795+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T21:00:02.438795+0000","last_peered":"2024-05-08T21:00:02.438795+0000","last_clean":"2024-05-08T21:00:02.438795+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:02.438795+0000","last_undegraded":"2024-05-08T21:00:02.438795+0000","last_fullsized":"2024-05-08T21:00:02.438795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438312+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T21:00:02.438312+0000","last_peered":"2024-05-08T21:00:02.438312+0000","last_clean":"2024-05-08T21:00:02.438312+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:00:02.438312+0000","last_undegraded":"2024-05-08T21:00:02.438312+0000","last_fullsized":"2024-05-08T21:00:02.438312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441808+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T21:00:02.441808+0000","last_peered":"2024-05-08T21:00:02.441808+0000","last_clean":"2024-05-08T21:00:02.441808+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:00:02.441808+0000","last_undegraded":"2024-05-08T21:00:02.441808+0000","last_fullsized":"2024-05-08T21:00:02.441808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443042+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T21:00:02.443042+0000","last_peered":"2024-05-08T21:00:02.443042+0000","last_clean":"2024-05-08T21:00:02.443042+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:00:02.443042+0000","last_undegraded":"2024-05-08T21:00:02.443042+0000","last_fullsized":"2024-05-08T21:00:02.443042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447313+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T21:00:02.447313+0000","last_peered":"2024-05-08T21:00:02.447313+0000","last_clean":"2024-05-08T21:00:02.447313+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:00:02.447313+0000","last_undegraded":"2024-05-08T21:00:02.447313+0000","last_fullsized":"2024-05-08T21:00:02.447313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:11:29.435206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440323+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T21:00:02.440323+0000","last_peered":"2024-05-08T21:00:02.440323+0000","last_clean":"2024-05-08T21:00:02.440323+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:00:02.440323+0000","last_undegraded":"2024-05-08T21:00:02.440323+0000","last_fullsized":"2024-05-08T21:00:02.440323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443423+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T21:00:02.443423+0000","last_peered":"2024-05-08T21:00:02.443423+0000","last_clean":"2024-05-08T21:00:02.443423+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:00:02.443423+0000","last_undegraded":"2024-05-08T21:00:02.443423+0000","last_fullsized":"2024-05-08T21:00:02.443423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:54.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446673+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T21:00:02.446673+0000","last_peered":"2024-05-08T21:00:02.446673+0000","last_clean":"2024-05-08T21:00:02.446673+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:00:02.446673+0000","last_undegraded":"2024-05-08T21:00:02.446673+0000","last_fullsized":"2024-05-08T21:00:02.446673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441716+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T21:00:02.441716+0000","last_peered":"2024-05-08T21:00:02.441716+0000","last_clean":"2024-05-08T21:00:02.441716+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:00:02.441716+0000","last_undegraded":"2024-05-08T21:00:02.441716+0000","last_fullsized":"2024-05-08T21:00:02.441716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441777+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T21:00:02.441777+0000","last_peered":"2024-05-08T21:00:02.441777+0000","last_clean":"2024-05-08T21:00:02.441777+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:02.441777+0000","last_undegraded":"2024-05-08T21:00:02.441777+0000","last_fullsized":"2024-05-08T21:00:02.441777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:04:37.053936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424189+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T21:00:02.424189+0000","last_peered":"2024-05-08T21:00:02.424189+0000","last_clean":"2024-05-08T21:00:02.424189+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:02.424189+0000","last_undegraded":"2024-05-08T21:00:02.424189+0000","last_fullsized":"2024-05-08T21:00:02.424189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440539+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T21:00:02.440539+0000","last_peered":"2024-05-08T21:00:02.440539+0000","last_clean":"2024-05-08T21:00:02.440539+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:02.440539+0000","last_undegraded":"2024-05-08T21:00:02.440539+0000","last_fullsized":"2024-05-08T21:00:02.440539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437691+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T21:00:02.437691+0000","last_peered":"2024-05-08T21:00:02.437691+0000","last_clean":"2024-05-08T21:00:02.437691+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:02.437691+0000","last_undegraded":"2024-05-08T21:00:02.437691+0000","last_fullsized":"2024-05-08T21:00:02.437691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424000+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T21:00:02.424000+0000","last_peered":"2024-05-08T21:00:02.424000+0000","last_clean":"2024-05-08T21:00:02.424000+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:02.424000+0000","last_undegraded":"2024-05-08T21:00:02.424000+0000","last_fullsized":"2024-05-08T21:00:02.424000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.434610+0000","last_change":"2024-05-08T20:57:23.947280+0000","last_active":"2024-05-08T21:00:02.434610+0000","last_peered":"2024-05-08T21:00:02.434610+0000","last_clean":"2024-05-08T21:00:02.434610+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:02.434610+0000","last_undegraded":"2024-05-08T21:00:02.434610+0000","last_fullsized":"2024-05-08T21:00:02.434610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:51.369610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446463+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T21:00:02.446463+0000","last_peered":"2024-05-08T21:00:02.446463+0000","last_clean":"2024-05-08T21:00:02.446463+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:02.446463+0000","last_undegraded":"2024-05-08T21:00:02.446463+0000","last_fullsized":"2024-05-08T21:00:02.446463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:03.314607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.435282+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T21:00:02.435282+0000","last_peered":"2024-05-08T21:00:02.435282+0000","last_clean":"2024-05-08T21:00:02.435282+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:02.435282+0000","last_undegraded":"2024-05-08T21:00:02.435282+0000","last_fullsized":"2024-05-08T21:00:02.435282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429848+0000","last_change":"2024-05-08T20:57:23.938502+0000","last_active":"2024-05-08T21:00:02.429848+0000","last_peered":"2024-05-08T21:00:02.429848+0000","last_clean":"2024-05-08T21:00:02.429848+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:00:02.429848+0000","last_undegraded":"2024-05-08T21:00:02.429848+0000","last_fullsized":"2024-05-08T21:00:02.429848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433101+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T21:00:02.433101+0000","last_peered":"2024-05-08T21:00:02.433101+0000","last_clean":"2024-05-08T21:00:02.433101+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.433101+0000","last_undegraded":"2024-05-08T21:00:02.433101+0000","last_fullsized":"2024-05-08T21:00:02.433101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443484+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T21:00:02.443484+0000","last_peered":"2024-05-08T21:00:02.443484+0000","last_clean":"2024-05-08T21:00:02.443484+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:00:02.443484+0000","last_undegraded":"2024-05-08T21:00:02.443484+0000","last_fullsized":"2024-05-08T21:00:02.443484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447239+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T21:00:02.447239+0000","last_peered":"2024-05-08T21:00:02.447239+0000","last_clean":"2024-05-08T21:00:02.447239+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:00:02.447239+0000","last_undegraded":"2024-05-08T21:00:02.447239+0000","last_fullsized":"2024-05-08T21:00:02.447239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424005+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T21:00:02.424005+0000","last_peered":"2024-05-08T21:00:02.424005+0000","last_clean":"2024-05-08T21:00:02.424005+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:02.424005+0000","last_undegraded":"2024-05-08T21:00:02.424005+0000","last_fullsized":"2024-05-08T21:00:02.424005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:16.674886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438896+0000","last_change":"2024-05-08T20:56:41.799775+0000","last_active":"2024-05-08T21:00:02.438896+0000","last_peered":"2024-05-08T21:00:02.438896+0000","last_clean":"2024-05-08T21:00:02.438896+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:02.438896+0000","last_undegraded":"2024-05-08T21:00:02.438896+0000","last_fullsized":"2024-05-08T21:00:02.438896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.422268+0000","last_change":"2024-05-08T20:56:41.806833+0000","last_active":"2024-05-08T21:00:02.422268+0000","last_peered":"2024-05-08T21:00:02.422268+0000","last_clean":"2024-05-08T21:00:02.422268+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:02.422268+0000","last_undegraded":"2024-05-08T21:00:02.422268+0000","last_fullsized":"2024-05-08T21:00:02.422268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444304+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T21:00:02.444304+0000","last_peered":"2024-05-08T21:00:02.444304+0000","last_clean":"2024-05-08T21:00:02.444304+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:00:02.444304+0000","last_undegraded":"2024-05-08T21:00:02.444304+0000","last_fullsized":"2024-05-08T21:00:02.444304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431135+0000","last_change":"2024-05-08T20:56:41.794948+0000","last_active":"2024-05-08T21:00:02.431135+0000","last_peered":"2024-05-08T21:00:02.431135+0000","last_clean":"2024-05-08T21:00:02.431135+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:02.431135+0000","last_undegraded":"2024-05-08T21:00:02.431135+0000","last_fullsized":"2024-05-08T21:00:02.431135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428265+0000","last_change":"2024-05-08T20:57:23.945199+0000","last_active":"2024-05-08T21:00:02.428265+0000","last_peered":"2024-05-08T21:00:02.428265+0000","last_clean":"2024-05-08T21:00:02.428265+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:00:02.428265+0000","last_undegraded":"2024-05-08T21:00:02.428265+0000","last_fullsized":"2024-05-08T21:00:02.428265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439072+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T21:00:02.439072+0000","last_peered":"2024-05-08T21:00:02.439072+0000","last_clean":"2024-05-08T21:00:02.439072+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:00:02.439072+0000","last_undegraded":"2024-05-08T21:00:02.439072+0000","last_fullsized":"2024-05-08T21:00:02.439072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445362+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T21:00:02.445362+0000","last_peered":"2024-05-08T21:00:02.445362+0000","last_clean":"2024-05-08T21:00:02.445362+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:00:02.445362+0000","last_undegraded":"2024-05-08T21:00:02.445362+0000","last_fullsized":"2024-05-08T21:00:02.445362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444671+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T21:00:02.444671+0000","last_peered":"2024-05-08T21:00:02.444671+0000","last_clean":"2024-05-08T21:00:02.444671+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:02.444671+0000","last_undegraded":"2024-05-08T21:00:02.444671+0000","last_fullsized":"2024-05-08T21:00:02.444671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:54.982450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":82,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442467+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T21:00:02.442467+0000","last_peered":"2024-05-08T21:00:02.442467+0000","last_clean":"2024-05-08T21:00:02.442467+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:02.442467+0000","last_undegraded":"2024-05-08T21:00:02.442467+0000","last_fullsized":"2024-05-08T21:00:02.442467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428747+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T21:00:02.428747+0000","last_peered":"2024-05-08T21:00:02.428747+0000","last_clean":"2024-05-08T21:00:02.428747+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:02.428747+0000","last_undegraded":"2024-05-08T21:00:02.428747+0000","last_fullsized":"2024-05-08T21:00:02.428747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:18.210197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1517","reported_seq":1531,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202034+0000","last_change":"2024-05-08T20:56:41.417276+0000","last_active":"2024-05-08T20:59:50.202034+0000","last_peered":"2024-05-08T20:59:50.202034+0000","last_clean":"2024-05-08T20:59:50.202034+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T20:59:50.202034+0000","last_undegraded":"2024-05-08T20:59:50.202034+0000","last_fullsized":"2024-05-08T20:59:50.202034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":1517,"log_dups_size":0,"ondisk_log_size":1517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439171+0000","last_change":"2024-05-08T20:56:41.811008+0000","last_active":"2024-05-08T21:00:02.439171+0000","last_peered":"2024-05-08T21:00:02.439171+0000","last_clean":"2024-05-08T21:00:02.439171+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:02.439171+0000","last_undegraded":"2024-05-08T21:00:02.439171+0000","last_fullsized":"2024-05-08T21:00:02.439171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188425+0000","last_change":"2024-05-08T20:56:41.412494+0000","last_active":"2024-05-08T20:59:50.188425+0000","last_peered":"2024-05-08T20:59:50.188425+0000","last_clean":"2024-05-08T20:59:50.188425+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T20:59:50.188425+0000","last_undegraded":"2024-05-08T20:59:50.188425+0000","last_fullsized":"2024-05-08T20:59:50.188425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.191949+0000","last_change":"2024-05-08T20:56:41.405882+0000","last_active":"2024-05-08T20:59:50.191949+0000","last_peered":"2024-05-08T20:59:50.191949+0000","last_clean":"2024-05-08T20:59:50.191949+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T20:59:50.191949+0000","last_undegraded":"2024-05-08T20:59:50.191949+0000","last_fullsized":"2024-05-08T20:59:50.191949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437829+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T21:00:02.437829+0000","last_peered":"2024-05-08T21:00:02.437829+0000","last_clean":"2024-05-08T21:00:02.437829+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:00:02.437829+0000","last_undegraded":"2024-05-08T21:00:02.437829+0000","last_fullsized":"2024-05-08T21:00:02.437829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201560+0000","last_change":"2024-05-08T20:56:41.413506+0000","last_active":"2024-05-08T20:59:50.201560+0000","last_peered":"2024-05-08T20:59:50.201560+0000","last_clean":"2024-05-08T20:59:50.201560+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T20:59:50.201560+0000","last_undegraded":"2024-05-08T20:59:50.201560+0000","last_fullsized":"2024-05-08T20:59:50.201560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.434476+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T21:00:02.434476+0000","last_peered":"2024-05-08T21:00:02.434476+0000","last_clean":"2024-05-08T21:00:02.434476+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:02.434476+0000","last_undegraded":"2024-05-08T21:00:02.434476+0000","last_fullsized":"2024-05-08T21:00:02.434476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.188688+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T20:59:50.188688+0000","last_peered":"2024-05-08T20:59:50.188688+0000","last_clean":"2024-05-08T20:59:50.188688+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T20:59:50.188688+0000","last_undegraded":"2024-05-08T20:59:50.188688+0000","last_fullsized":"2024-05-08T20:59:50.188688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":86,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446668+0000","last_change":"2024-05-08T20:56:41.796690+0000","last_active":"2024-05-08T21:00:02.446668+0000","last_peered":"2024-05-08T21:00:02.446668+0000","last_clean":"2024-05-08T21:00:02.446668+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:02.446668+0000","last_undegraded":"2024-05-08T21:00:02.446668+0000","last_fullsized":"2024-05-08T21:00:02.446668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:10.754417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201606+0000","last_change":"2024-05-08T20:56:41.407619+0000","last_active":"2024-05-08T20:59:50.201606+0000","last_peered":"2024-05-08T20:59:50.201606+0000","last_clean":"2024-05-08T20:59:50.201606+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T20:59:50.201606+0000","last_undegraded":"2024-05-08T20:59:50.201606+0000","last_fullsized":"2024-05-08T20:59:50.201606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445430+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T21:00:02.445430+0000","last_peered":"2024-05-08T21:00:02.445430+0000","last_clean":"2024-05-08T21:00:02.445430+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:02.445430+0000","last_undegraded":"2024-05-08T21:00:02.445430+0000","last_fullsized":"2024-05-08T21:00:02.445430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'49","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.197487+0000","last_change":"2024-05-08T20:56:41.416810+0000","last_active":"2024-05-08T21:00:01.197487+0000","last_peered":"2024-05-08T21:00:01.197487+0000","last_clean":"2024-05-08T21:00:01.197487+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:01.197487+0000","last_undegraded":"2024-05-08T21:00:01.197487+0000","last_fullsized":"2024-05-08T21:00:01.197487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444429+0000","last_change":"2024-05-08T20:56:41.807802+0000","last_active":"2024-05-08T21:00:02.444429+0000","last_peered":"2024-05-08T21:00:02.444429+0000","last_clean":"2024-05-08T21:00:02.444429+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:02.444429+0000","last_undegraded":"2024-05-08T21:00:02.444429+0000","last_fullsized":"2024-05-08T21:00:02.444429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:50.119512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'912","reported_seq":926,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:55.140352+0000","last_change":"2024-05-08T20:56:41.414162+0000","last_active":"2024-05-08T20:59:55.140352+0000","last_peered":"2024-05-08T20:59:55.140352+0000","last_clean":"2024-05-08T20:59:55.140352+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T20:59:55.140352+0000","last_undegraded":"2024-05-08T20:59:55.140352+0000","last_fullsized":"2024-05-08T20:59:55.140352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":912,"log_dups_size":0,"ondisk_log_size":912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442866+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442866+0000","last_peered":"2024-05-08T21:00:02.442866+0000","last_clean":"2024-05-08T21:00:02.442866+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442866+0000","last_undegraded":"2024-05-08T21:00:02.442866+0000","last_fullsized":"2024-05-08T21:00:02.442866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'17","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:57.782679+0000","last_change":"2024-05-08T20:56:41.412762+0000","last_active":"2024-05-08T20:59:57.782679+0000","last_peered":"2024-05-08T20:59:57.782679+0000","last_clean":"2024-05-08T20:59:57.782679+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T20:59:57.782679+0000","last_undegraded":"2024-05-08T20:59:57.782679+0000","last_fullsized":"2024-05-08T20:59:57.782679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443235+0000","last_change":"2024-05-08T20:56:41.795361+0000","last_active":"2024-05-08T21:00:02.443235+0000","last_peered":"2024-05-08T21:00:02.443235+0000","last_clean":"2024-05-08T21:00:02.443235+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:02.443235+0000","last_undegraded":"2024-05-08T21:00:02.443235+0000","last_fullsized":"2024-05-08T21:00:02.443235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:54.089782+0000","last_change":"2024-05-08T20:56:41.413064+0000","last_active":"2024-05-08T20:59:54.089782+0000","last_peered":"2024-05-08T20:59:54.089782+0000","last_clean":"2024-05-08T20:59:54.089782+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T20:59:54.089782+0000","last_undegraded":"2024-05-08T20:59:54.089782+0000","last_fullsized":"2024-05-08T20:59:54.089782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444142+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T21:00:02.444142+0000","last_peered":"2024-05-08T21:00:02.444142+0000","last_clean":"2024-05-08T21:00:02.444142+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:00:02.444142+0000","last_undegraded":"2024-05-08T21:00:02.444142+0000","last_fullsized":"2024-05-08T21:00:02.444142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:40.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.112953+0000","last_change":"2024-05-08T20:56:41.415102+0000","last_active":"2024-05-08T20:59:56.112953+0000","last_peered":"2024-05-08T20:59:56.112953+0000","last_clean":"2024-05-08T20:59:56.112953+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T20:59:56.112953+0000","last_undegraded":"2024-05-08T20:59:56.112953+0000","last_fullsized":"2024-05-08T20:59:56.112953+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437682+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T21:00:02.437682+0000","last_peered":"2024-05-08T21:00:02.437682+0000","last_clean":"2024-05-08T21:00:02.437682+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:02.437682+0000","last_undegraded":"2024-05-08T21:00:02.437682+0000","last_fullsized":"2024-05-08T21:00:02.437682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:52.146287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'32","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:56.146830+0000","last_change":"2024-05-08T20:56:41.413528+0000","last_active":"2024-05-08T20:59:56.146830+0000","last_peered":"2024-05-08T20:59:56.146830+0000","last_clean":"2024-05-08T20:59:56.146830+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T20:59:56.146830+0000","last_undegraded":"2024-05-08T20:59:56.146830+0000","last_fullsized":"2024-05-08T20:59:56.146830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:21.989366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442900+0000","last_change":"2024-05-08T20:56:41.811071+0000","last_active":"2024-05-08T21:00:02.442900+0000","last_peered":"2024-05-08T21:00:02.442900+0000","last_clean":"2024-05-08T21:00:02.442900+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.442900+0000","last_undegraded":"2024-05-08T21:00:02.442900+0000","last_fullsized":"2024-05-08T21:00:02.442900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:58.468561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'23","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.194192+0000","last_change":"2024-05-08T20:56:41.420345+0000","last_active":"2024-05-08T20:59:50.194192+0000","last_peered":"2024-05-08T20:59:50.194192+0000","last_clean":"2024-05-08T20:59:50.194192+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T20:59:50.194192+0000","last_undegraded":"2024-05-08T20:59:50.194192+0000","last_fullsized":"2024-05-08T20:59:50.194192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:22.095324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442829+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T21:00:02.442829+0000","last_peered":"2024-05-08T21:00:02.442829+0000","last_clean":"2024-05-08T21:00:02.442829+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:02.442829+0000","last_undegraded":"2024-05-08T21:00:02.442829+0000","last_fullsized":"2024-05-08T21:00:02.442829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:49:41.308235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202258+0000","last_change":"2024-05-08T20:56:41.408855+0000","last_active":"2024-05-08T20:59:50.202258+0000","last_peered":"2024-05-08T20:59:50.202258+0000","last_clean":"2024-05-08T20:59:50.202258+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T20:59:50.202258+0000","last_undegraded":"2024-05-08T20:59:50.202258+0000","last_fullsized":"2024-05-08T20:59:50.202258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:28.094997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443122+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T21:00:02.443122+0000","last_peered":"2024-05-08T21:00:02.443122+0000","last_clean":"2024-05-08T21:00:02.443122+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:00:02.443122+0000","last_undegraded":"2024-05-08T21:00:02.443122+0000","last_fullsized":"2024-05-08T21:00:02.443122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:12:28.898397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'24","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.199642+0000","last_change":"2024-05-08T20:56:41.413508+0000","last_active":"2024-05-08T20:59:50.199642+0000","last_peered":"2024-05-08T20:59:50.199642+0000","last_clean":"2024-05-08T20:59:50.199642+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T20:59:50.199642+0000","last_undegraded":"2024-05-08T20:59:50.199642+0000","last_fullsized":"2024-05-08T20:59:50.199642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441899+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T21:00:02.441899+0000","last_peered":"2024-05-08T21:00:02.441899+0000","last_clean":"2024-05-08T21:00:02.441899+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:02.441899+0000","last_undegraded":"2024-05-08T21:00:02.441899+0000","last_fullsized":"2024-05-08T21:00:02.441899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:00.040523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196209+0000","last_change":"2024-05-08T20:56:41.407690+0000","last_active":"2024-05-08T20:59:50.196209+0000","last_peered":"2024-05-08T20:59:50.196209+0000","last_clean":"2024-05-08T20:59:50.196209+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T20:59:50.196209+0000","last_undegraded":"2024-05-08T20:59:50.196209+0000","last_fullsized":"2024-05-08T20:59:50.196209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442928+0000","last_change":"2024-05-08T20:57:23.939637+0000","last_active":"2024-05-08T21:00:02.442928+0000","last_peered":"2024-05-08T21:00:02.442928+0000","last_clean":"2024-05-08T21:00:02.442928+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:00:02.442928+0000","last_undegraded":"2024-05-08T21:00:02.442928+0000","last_fullsized":"2024-05-08T21:00:02.442928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:34.651453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:57:23.936478+0000","last_change":"2024-05-08T20:56:30.269432+0000","last_active":"2024-05-08T20:57:23.936478+0000","last_peered":"2024-05-08T20:57:23.936478+0000","last_clean":"2024-05-08T20:57:23.936478+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T20:57:23.936478+0000","last_undegraded":"2024-05-08T20:57:23.936478+0000","last_fullsized":"2024-05-08T20:57:23.936478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:29.246163+0000","last_clean_scrub_stamp":"2024-05-08T20:56:29.246163+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:39:55.050207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196651+0000","last_change":"2024-05-08T20:56:41.411913+0000","last_active":"2024-05-08T20:59:50.196651+0000","last_peered":"2024-05-08T20:59:50.196651+0000","last_clean":"2024-05-08T20:59:50.196651+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T20:59:50.196651+0000","last_undegraded":"2024-05-08T20:59:50.196651+0000","last_fullsized":"2024-05-08T20:59:50.196651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445409+0000","last_change":"2024-05-08T20:57:23.937184+0000","last_active":"2024-05-08T21:00:02.445409+0000","last_peered":"2024-05-08T21:00:02.445409+0000","last_clean":"2024-05-08T21:00:02.445409+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:02.445409+0000","last_undegraded":"2024-05-08T21:00:02.445409+0000","last_fullsized":"2024-05-08T21:00:02.445409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:33:09.178871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206244+0000","last_change":"2024-05-08T20:56:41.419536+0000","last_active":"2024-05-08T20:59:50.206244+0000","last_peered":"2024-05-08T20:59:50.206244+0000","last_clean":"2024-05-08T20:59:50.206244+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T20:59:50.206244+0000","last_undegraded":"2024-05-08T20:59:50.206244+0000","last_fullsized":"2024-05-08T20:59:50.206244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438195+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T21:00:02.438195+0000","last_peered":"2024-05-08T21:00:02.438195+0000","last_clean":"2024-05-08T21:00:02.438195+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:02.438195+0000","last_undegraded":"2024-05-08T21:00:02.438195+0000","last_fullsized":"2024-05-08T21:00:02.438195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'73","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.174851+0000","last_change":"2024-05-08T20:56:41.406891+0000","last_active":"2024-05-08T21:00:01.174851+0000","last_peered":"2024-05-08T21:00:01.174851+0000","last_clean":"2024-05-08T21:00:01.174851+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:01.174851+0000","last_undegraded":"2024-05-08T21:00:01.174851+0000","last_fullsized":"2024-05-08T21:00:01.174851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:51.177882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428840+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T21:00:02.428840+0000","last_peered":"2024-05-08T21:00:02.428840+0000","last_clean":"2024-05-08T21:00:02.428840+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:00:02.428840+0000","last_undegraded":"2024-05-08T21:00:02.428840+0000","last_fullsized":"2024-05-08T21:00:02.428840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.206180+0000","last_change":"2024-05-08T20:56:41.413359+0000","last_active":"2024-05-08T20:59:50.206180+0000","last_peered":"2024-05-08T20:59:50.206180+0000","last_clean":"2024-05-08T20:59:50.206180+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T20:59:50.206180+0000","last_undegraded":"2024-05-08T20:59:50.206180+0000","last_fullsized":"2024-05-08T20:59:50.206180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:39:10.552772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439343+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T21:00:02.439343+0000","last_peered":"2024-05-08T21:00:02.439343+0000","last_clean":"2024-05-08T21:00:02.439343+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:02.439343+0000","last_undegraded":"2024-05-08T21:00:02.439343+0000","last_fullsized":"2024-05-08T21:00:02.439343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:24.833149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.205171+0000","last_change":"2024-05-08T20:56:41.410781+0000","last_active":"2024-05-08T20:59:50.205171+0000","last_peered":"2024-05-08T20:59:50.205171+0000","last_clean":"2024-05-08T20:59:50.205171+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T20:59:50.205171+0000","last_undegraded":"2024-05-08T20:59:50.205171+0000","last_fullsized":"2024-05-08T20:59:50.205171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441988+0000","last_change":"2024-05-08T20:56:41.799689+0000","last_active":"2024-05-08T21:00:02.441988+0000","last_peered":"2024-05-08T21:00:02.441988+0000","last_clean":"2024-05-08T21:00:02.441988+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:02.441988+0000","last_undegraded":"2024-05-08T21:00:02.441988+0000","last_fullsized":"2024-05-08T21:00:02.441988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:23:46.536593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202542+0000","last_change":"2024-05-08T20:56:41.421312+0000","last_active":"2024-05-08T20:59:50.202542+0000","last_peered":"2024-05-08T20:59:50.202542+0000","last_clean":"2024-05-08T20:59:50.202542+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T20:59:50.202542+0000","last_undegraded":"2024-05-08T20:59:50.202542+0000","last_fullsized":"2024-05-08T20:59:50.202542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.978854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429055+0000","last_change":"2024-05-08T20:56:41.795580+0000","last_active":"2024-05-08T21:00:02.429055+0000","last_peered":"2024-05-08T21:00:02.429055+0000","last_clean":"2024-05-08T21:00:02.429055+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:02.429055+0000","last_undegraded":"2024-05-08T21:00:02.429055+0000","last_fullsized":"2024-05-08T21:00:02.429055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'40","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:05.372505+0000","last_change":"2024-05-08T20:56:41.409186+0000","last_active":"2024-05-08T21:00:05.372505+0000","last_peered":"2024-05-08T21:00:05.372505+0000","last_clean":"2024-05-08T21:00:05.372505+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:05.372505+0000","last_undegraded":"2024-05-08T21:00:05.372505+0000","last_fullsized":"2024-05-08T21:00:05.372505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444857+0000","last_change":"2024-05-08T20:56:41.797726+0000","last_active":"2024-05-08T21:00:02.444857+0000","last_peered":"2024-05-08T21:00:02.444857+0000","last_clean":"2024-05-08T21:00:02.444857+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:02.444857+0000","last_undegraded":"2024-05-08T21:00:02.444857+0000","last_fullsized":"2024-05-08T21:00:02.444857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:12:29.039985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'26","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.178249+0000","last_change":"2024-05-08T20:56:41.420713+0000","last_active":"2024-05-08T21:00:01.178249+0000","last_peered":"2024-05-08T21:00:01.178249+0000","last_clean":"2024-05-08T21:00:01.178249+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:01.178249+0000","last_undegraded":"2024-05-08T21:00:01.178249+0000","last_fullsized":"2024-05-08T21:00:01.178249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433960+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T21:00:02.433960+0000","last_peered":"2024-05-08T21:00:02.433960+0000","last_clean":"2024-05-08T21:00:02.433960+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:02.433960+0000","last_undegraded":"2024-05-08T21:00:02.433960+0000","last_fullsized":"2024-05-08T21:00:02.433960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.202507+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:59:50.202507+0000","last_peered":"2024-05-08T20:59:50.202507+0000","last_clean":"2024-05-08T20:59:50.202507+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:59:50.202507+0000","last_undegraded":"2024-05-08T20:59:50.202507+0000","last_fullsized":"2024-05-08T20:59:50.202507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:08:23.829553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.420471+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T21:00:02.420471+0000","last_peered":"2024-05-08T21:00:02.420471+0000","last_clean":"2024-05-08T21:00:02.420471+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:02.420471+0000","last_undegraded":"2024-05-08T21:00:02.420471+0000","last_fullsized":"2024-05-08T21:00:02.420471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:22.708850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:00.188027+0000","last_change":"2024-05-08T20:56:41.411198+0000","last_active":"2024-05-08T21:00:00.188027+0000","last_peered":"2024-05-08T21:00:00.188027+0000","last_clean":"2024-05-08T21:00:00.188027+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T21:00:00.188027+0000","last_undegraded":"2024-05-08T21:00:00.188027+0000","last_fullsized":"2024-05-08T21:00:00.188027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.430991+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T21:00:02.430991+0000","last_peered":"2024-05-08T21:00:02.430991+0000","last_clean":"2024-05-08T21:00:02.430991+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:00:02.430991+0000","last_undegraded":"2024-05-08T21:00:02.430991+0000","last_fullsized":"2024-05-08T21:00:02.430991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:55.710206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.196125+0000","last_change":"2024-05-08T20:56:41.417158+0000","last_active":"2024-05-08T20:59:50.196125+0000","last_peered":"2024-05-08T20:59:50.196125+0000","last_clean":"2024-05-08T20:59:50.196125+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T20:59:50.196125+0000","last_undegraded":"2024-05-08T20:59:50.196125+0000","last_fullsized":"2024-05-08T20:59:50.196125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438822+0000","last_change":"2024-05-08T20:56:41.800029+0000","last_active":"2024-05-08T21:00:02.438822+0000","last_peered":"2024-05-08T21:00:02.438822+0000","last_clean":"2024-05-08T21:00:02.438822+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:02.438822+0000","last_undegraded":"2024-05-08T21:00:02.438822+0000","last_fullsized":"2024-05-08T21:00:02.438822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:31.454253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'518","reported_seq":532,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.203240+0000","last_change":"2024-05-08T20:56:41.421535+0000","last_active":"2024-05-08T20:59:50.203240+0000","last_peered":"2024-05-08T20:59:50.203240+0000","last_clean":"2024-05-08T20:59:50.203240+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T20:59:50.203240+0000","last_undegraded":"2024-05-08T20:59:50.203240+0000","last_fullsized":"2024-05-08T20:59:50.203240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:39.072470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431702+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T21:00:02.431702+0000","last_peered":"2024-05-08T21:00:02.431702+0000","last_clean":"2024-05-08T21:00:02.431702+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:02.431702+0000","last_undegraded":"2024-05-08T21:00:02.431702+0000","last_fullsized":"2024-05-08T21:00:02.431702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444036+0000","last_change":"2024-05-08T20:57:23.945794+0000","last_active":"2024-05-08T21:00:02.444036+0000","last_peered":"2024-05-08T21:00:02.444036+0000","last_clean":"2024-05-08T21:00:02.444036+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:02.444036+0000","last_undegraded":"2024-05-08T21:00:02.444036+0000","last_fullsized":"2024-05-08T21:00:02.444036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:33.164158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.192833+0000","last_change":"2024-05-08T20:56:41.419049+0000","last_active":"2024-05-08T20:59:50.192833+0000","last_peered":"2024-05-08T20:59:50.192833+0000","last_clean":"2024-05-08T20:59:50.192833+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T20:59:50.192833+0000","last_undegraded":"2024-05-08T20:59:50.192833+0000","last_fullsized":"2024-05-08T20:59:50.192833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:17.206601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429835+0000","last_change":"2024-05-08T20:57:23.945132+0000","last_active":"2024-05-08T21:00:02.429835+0000","last_peered":"2024-05-08T21:00:02.429835+0000","last_clean":"2024-05-08T21:00:02.429835+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:02.429835+0000","last_undegraded":"2024-05-08T21:00:02.429835+0000","last_fullsized":"2024-05-08T21:00:02.429835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:36:56.195391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:15.270867+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T21:00:15.270867+0000","last_peered":"2024-05-08T21:00:15.270867+0000","last_clean":"2024-05-08T21:00:15.270867+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:15.270867+0000","last_undegraded":"2024-05-08T21:00:15.270867+0000","last_fullsized":"2024-05-08T21:00:15.270867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:49.115916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445292+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T21:00:02.445292+0000","last_peered":"2024-05-08T21:00:02.445292+0000","last_clean":"2024-05-08T21:00:02.445292+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:02.445292+0000","last_undegraded":"2024-05-08T21:00:02.445292+0000","last_fullsized":"2024-05-08T21:00:02.445292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:53.768715+0000","last_change":"2024-05-08T20:56:41.409635+0000","last_active":"2024-05-08T20:59:53.768715+0000","last_peered":"2024-05-08T20:59:53.768715+0000","last_clean":"2024-05-08T20:59:53.768715+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T20:59:53.768715+0000","last_undegraded":"2024-05-08T20:59:53.768715+0000","last_fullsized":"2024-05-08T20:59:53.768715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:21.705254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439978+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T21:00:02.439978+0000","last_peered":"2024-05-08T21:00:02.439978+0000","last_clean":"2024-05-08T21:00:02.439978+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:02.439978+0000","last_undegraded":"2024-05-08T21:00:02.439978+0000","last_fullsized":"2024-05-08T21:00:02.439978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:36:53.336166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'49","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.201580+0000","last_change":"2024-05-08T20:56:41.410460+0000","last_active":"2024-05-08T20:59:50.201580+0000","last_peered":"2024-05-08T20:59:50.201580+0000","last_clean":"2024-05-08T20:59:50.201580+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T20:59:50.201580+0000","last_undegraded":"2024-05-08T20:59:50.201580+0000","last_fullsized":"2024-05-08T20:59:50.201580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090874,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3114,"num_write_kb":31562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3821,"ondisk_log_size":3821,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77900000000000003,"15min":0.80800000000000005},"min":{"1min":0.53200000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95399999999999996,"5min":1.22,"15min":1.22},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.83599999999999997,"15min":0.84599999999999997},"min":{"1min":0.52400000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.244,"5min":1.254,"15min":1.254},"last":1.016}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.91300000000000003,"15min":0.93500000000000005},"min":{"1min":0.59899999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.236,"5min":1.298,"15min":1.298},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.99399999999999999},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.93100000000000005,"15min":0.97399999999999998},"min":{"1min":0.63,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1850000000000001,"5min":1.274,"15min":1.274},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1,"15min":1.042},"min":{"1min":0.73199999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3120000000000001,"5min":1.399,"15min":1.399},"last":0.64800000000000002}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.86699999999999999,"15min":0.86799999999999999},"min":{"1min":0.64200000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.042,"15min":1.0960000000000001},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1919999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.92800000000000005,"15min":0.94599999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0529999999999999,"15min":1.0760000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.3819999999999999,"5min":1.397,"15min":1.397},"last":0.92600000000000005}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0680000000000001,"15min":1.095},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1519999999999999,"5min":1.425,"15min":1.425},"last":1.091},{"interface":"front","average":{"1min":1.046,"5min":1.121,"15min":1.1439999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.5169999999999999,"5min":1.734,"15min":1.734},"last":1.3029999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.1519999999999999,"15min":1.1779999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.583,"5min":1.821,"15min":1.821},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.173,"15min":1.2010000000000001},"min":{"1min":0.84499999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":1.1639999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14039081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.88900000000000001,"15min":0.93100000000000005},"min":{"1min":0.45500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2150000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.878,"15min":0.92400000000000004},"min":{"1min":0.60799999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0309999999999999,"5min":1.343,"15min":1.343},"last":0.754}]},{"osd":1,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.95399999999999996,"15min":0.997},"min":{"1min":0.58899999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.26,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0269999999999999},"min":{"1min":0.75900000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.198,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.81599999999999995}]},{"osd":2,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85499999999999998,"15min":0.88100000000000001},"min":{"1min":0.57899999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.90300000000000002,"15min":0.92300000000000004},"min":{"1min":0.626,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1100000000000001,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.65300000000000002}]},{"osd":3,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93899999999999995,"15min":0.96899999999999997},"min":{"1min":0.64100000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.143,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.92800000000000005},"min":{"1min":0.58999999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.0189999999999999}]},{"osd":4,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.89400000000000002,"15min":0.90200000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.153,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0209999999999999,"15min":1.046},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2290000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.96299999999999997,"15min":0.96999999999999997},"min":{"1min":0.63,"5min":0.62,"15min":0.62},"max":{"1min":1.198,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.069},{"interface":"front","average":{"1min":1.034,"5min":1.077,"15min":1.089},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.3640000000000001,"5min":1.403,"15min":1.403},"last":0.98799999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1200000000000001,"15min":1.1419999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.369,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1060000000000001,"15min":1.119},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.3400000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.109}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.81999999999999995,"15min":0.85799999999999998},"min":{"1min":0.58099999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0600000000000001,"5min":1.173,"15min":1.173},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81799999999999995,"15min":0.81899999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.159,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0589999999999999}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.53100000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84399999999999997,"15min":0.85999999999999999},"min":{"1min":0.55700000000000005,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":1.0089999999999999}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.59099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.226,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.92700000000000005},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.0509999999999999,"5min":1.401,"15min":1.401},"last":0.82399999999999995}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.93100000000000005,"15min":0.95799999999999996},"min":{"1min":0.65500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.075,"5min":1.256,"15min":1.256},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.73699999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2150000000000001,"5min":1.341,"15min":1.341},"last":1.175}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.95399999999999996,"15min":0.96399999999999997},"min":{"1min":0.48199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.129,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.036},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.998,"15min":1.004},"min":{"1min":0.75800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.224,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.153}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.052,"15min":1.0600000000000001},"min":{"1min":0.66300000000000003,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.3320000000000001,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.071,"15min":1.0860000000000001},"min":{"1min":0.63100000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.244,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0800000000000001}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.083,"15min":1.079},"min":{"1min":0.66400000000000003,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.117},{"interface":"front","average":{"1min":1.117,"5min":1.1639999999999999,"15min":1.1830000000000001},"min":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4650000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.2350000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80200000000000005,"15min":0.82799999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0920000000000001,"5min":1.139,"15min":1.139},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89900000000000002,"15min":0.93300000000000005},"min":{"1min":0.54900000000000004,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.077,"5min":1.466,"15min":1.466},"last":0.59099999999999997}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2210000000000001,"5min":1.292,"15min":1.292},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.127,"5min":1.556,"15min":1.556},"last":1}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.85899999999999999,"15min":0.89400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.079,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86199999999999999,"15min":0.89200000000000002},"min":{"1min":0.55700000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.95799999999999996}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.90800000000000003,"15min":0.93999999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.169,"5min":1.613,"15min":1.613},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97899999999999998,"15min":1.0049999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.208,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.79500000000000004}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.89400000000000002,"15min":0.91800000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1200000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0640000000000001,"15min":1.0900000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.272,"5min":1.78,"15min":1.78},"last":1.2030000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":1.014,"15min":1.052},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.2110000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.998,"15min":1.02},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.333,"5min":1.784,"15min":1.784},"last":1.2529999999999999}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.0529999999999999,"15min":1.0820000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3089999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":1.089},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.1279999999999999,"15min":1.155},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.4410000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.115}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.66500000000000004},"min":{"1min":0.51400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.048,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.51900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.83199999999999996}]},{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.47499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.71499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0169999999999999,"5min":1.075,"15min":1.075},"last":0.872}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.74299999999999999,"15min":0.753},"min":{"1min":0.621,"5min":0.308,"15min":0.308},"max":{"1min":1.236,"5min":1.671,"15min":1.671},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.58199999999999996,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0629999999999999,"5min":1.302,"15min":1.302},"last":0.73899999999999999}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":1.002,"15min":1.02},"min":{"1min":0.69599999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.4950000000000001,"5min":1.522,"15min":1.522},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.0469999999999999,"15min":1.0549999999999999},"min":{"1min":0.72999999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.407,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.91600000000000004}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0229999999999999,"15min":1.0289999999999999},"min":{"1min":0.69499999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.994,"15min":1.994},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.878,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.444,"5min":2.198,"15min":2.198},"last":1.0329999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.0980000000000001,"15min":1.1080000000000001},"min":{"1min":0.85899999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4850000000000001,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1140000000000001,"15min":1.1240000000000001},"min":{"1min":0.82699999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4330000000000001,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.163}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1379999999999999,"15min":1.173},"min":{"1min":0.91900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.492,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.153,"15min":1.167},"min":{"1min":0.92200000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.403,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.1910000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59399999999999997,"15min":0.59899999999999998},"min":{"1min":0.46899999999999997,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.73499999999999999}]},{"osd":1,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.55100000000000005,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.101,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.311,"15min":0.311},"max":{"1min":1.081,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67100000000000004,"15min":0.68999999999999995},"min":{"1min":0.35399999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.56799999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0049999999999999}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.78000000000000003,"5min":0.496,"15min":0.496},"max":{"1min":1.4510000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.97999999999999998,"15min":1},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.349,"5min":1.577,"15min":1.577},"last":1.0880000000000001}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1,"15min":1.038},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.153,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0449999999999999,"15min":1.0620000000000001},"min":{"1min":0.71899999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.49,"5min":1.8,"15min":1.8},"last":1.1100000000000001}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.016,"15min":1.0409999999999999},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4379999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.054,"15min":1.1100000000000001},"min":{"1min":0.58699999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3149999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.026,"15min":1.042},"min":{"1min":0.71899999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.087,"15min":1.1459999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.254,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.0489999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.59399999999999997,"15min":0.59499999999999997},"min":{"1min":0.46700000000000003,"5min":0.224,"15min":0.224},"max":{"1min":0.872,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.69399999999999995,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1279999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64200000000000002,"15min":0.66400000000000003},"min":{"1min":0.48299999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.86399999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.871,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.63200000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.77500000000000002,"15min":0.78500000000000003},"min":{"1min":0.67400000000000004,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.67700000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66400000000000003}]},{"osd":4,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.012,"5min":0.98399999999999999,"15min":1.014},"min":{"1min":0.77700000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.341,"5min":1.901,"15min":1.901},"last":1.137}]},{"osd":5,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0569999999999999,"15min":1.1000000000000001},"min":{"1min":0.73499999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.298,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.276},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.034,"15min":1.04},"min":{"1min":0.84799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0349999999999999}]},{"osd":6,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.0640000000000001,"15min":1.0920000000000001},"min":{"1min":0.90500000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.149,"5min":1.105,"15min":1.1399999999999999},"min":{"1min":0.92000000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.371,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.212}]},{"osd":7,"last update":"Wed May 8 20:59:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.90000000000000002,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.115,"15min":1.143},"min":{"1min":0.96499999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6180000000000001,"5min":2.02,"15min":2.02},"last":0.86599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.59399999999999997},"min":{"1min":0.317,"5min":0.251,"15min":0.251},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.68400000000000005,"15min":0.70099999999999996},"min":{"1min":0.36699999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71599999999999997,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.72699999999999998,"15min":0.73299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2989999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.76300000000000001,"15min":0.82399999999999995},"min":{"1min":0.33100000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.96199999999999997,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.92200000000000004,"15min":0.99299999999999999},"min":{"1min":0.40400000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.153,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.67000000000000004}]},{"osd":4,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.92600000000000005,"15min":0.92200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.754},{"interface":"front","average":{"1min":1.077,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.64800000000000002,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.80600000000000005}]},{"osd":6,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0009999999999999,"15min":0.995},"min":{"1min":0.71499999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.038,"5min":1.212,"15min":1.327},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.526,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":0.85299999999999998}]},{"osd":7,"last update":"Wed May 8 20:59:37 2024","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":0.99399999999999999,"15min":1.0009999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.022,"15min":1.0449999999999999},"min":{"1min":0.67600000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.278,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:00:31.940 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.940 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.940 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.940 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.940 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.940 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.941 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.942 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.943 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.944 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.945 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.946 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T20:56:29.246163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.947 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.948 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.949 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.950 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.950 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.950 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:31.950 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:00:41.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:41.294 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:00:51.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:00:52.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.067+0000 7f5e7759e700 1 Processor -- start 2024-05-08T21:00:52.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.067+0000 7f5e7759e700 1 -- start start 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7759e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f5e7806ba80 0x7f5e780cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7759e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7815c6a0 con 0x7f5e780adfd0 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7759e700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7815ba90 con 0x7f5e780adbf0 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7759e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7815bd70 con 0x7f5e7806ba80 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e75d9b700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f5e780adfd0 0x7f5e78162d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57900/0 (socket says 172.21.15.107:57900) 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e75d9b700 1 -- 172.21.15.107:0/263671948 learned_addr learned my addr 172.21.15.107:0/263671948 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:00:52.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e76d9d700 1 --2- 172.21.15.107:0/263671948 >> v2:172.21.15.195:3300/0 conn(0x7f5e7806ba80 0x7f5e780cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7559a700 1 -- 172.21.15.107:0/263671948 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343440684 0 0) 0x7f5e7815c6a0 con 0x7f5e780adfd0 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7559a700 1 -- 172.21.15.107:0/263671948 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e600035d0 con 0x7f5e780adfd0 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e76d9d700 1 -- 172.21.15.107:0/263671948 >> v1:172.21.15.195:6789/0 conn(0x7f5e780adbf0 legacy=0x7f5e7806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e76d9d700 1 -- 172.21.15.107:0/263671948 >> v1:172.21.15.107:6789/0 conn(0x7f5e780adfd0 legacy=0x7f5e78162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e76d9d700 1 -- 172.21.15.107:0/263671948 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7815c050 con 0x7f5e7806ba80 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e76d9d700 1 --2- 172.21.15.107:0/263671948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e7806ba80 0x7f5e780cedd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009d90 tx=0x7f5e7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b72c3b5d952cca9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7559a700 1 -- 172.21.15.107:0/263671948 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7000e070 con 0x7f5e7806ba80 2024-05-08T21:00:52.080 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7559a700 1 -- 172.21.15.107:0/263671948 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7000bb20 con 0x7f5e7806ba80 2024-05-08T21:00:52.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.071+0000 7f5e7559a700 1 -- 172.21.15.107:0/263671948 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70012430 con 0x7f5e7806ba80 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- 172.21.15.107:0/263671948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e7806ba80 msgr2=0x7f5e780cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 --2- 172.21.15.107:0/263671948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e7806ba80 0x7f5e780cedd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009d90 tx=0x7f5e7000b330 comp rx=0 tx=0).stop 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- 172.21.15.107:0/263671948 shutdown_connections 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 --2- 172.21.15.107:0/263671948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e7806ba80 0x7f5e780cedd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- 172.21.15.107:0/263671948 >> 172.21.15.107:0/263671948 conn(0x7f5e78070960 msgr2=0x7f5e78070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- 172.21.15.107:0/263671948 shutdown_connections 2024-05-08T21:00:52.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- 172.21.15.107:0/263671948 wait complete. 2024-05-08T21:00:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 Processor -- start 2024-05-08T21:00:52.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- start start 2024-05-08T21:00:52.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 0x7f5e780b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e780adbf0 0x7f5e78141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780adfd0 0x7f5e780ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780b3720 con 0x7f5e7806ba80 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e780b2c50 con 0x7f5e780adfd0 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.075+0000 7f5e7759e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78152a60 con 0x7f5e780adbf0 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 0x7f5e780b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 0x7f5e780b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:32884/0 (socket says 172.21.15.107:32884) 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 -- 172.21.15.107:0/844113664 learned_addr learned my addr 172.21.15.107:0/844113664 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e76d9d700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780adfd0 0x7f5e780ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e75d9b700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e780adbf0 0x7f5e78141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 -- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e780adbf0 msgr2=0x7f5e78141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e780adbf0 0x7f5e78141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 -- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780adfd0 msgr2=0x7f5e780ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780adfd0 0x7f5e780ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 -- 172.21.15.107:0/844113664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009a70 con 0x7f5e7806ba80 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7659c700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 0x7f5e780b2710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c530 tx=0x7f5e6800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680052d0 con 0x7f5e7806ba80 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7814f9c0 con 0x7f5e7806ba80 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68005430 con 0x7f5e7806ba80 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e780b3160 con 0x7f5e7806ba80 2024-05-08T21:00:52.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680055a0 con 0x7f5e7806ba80 2024-05-08T21:00:52.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e780672a0 con 0x7f5e7806ba80 2024-05-08T21:00:52.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.079+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e680038a0 con 0x7f5e7806ba80 2024-05-08T21:00:52.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.083+0000 7f5e66ffd700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5e58066730 0x7f5e58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:00:52.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.083+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f5e680834b0 con 0x7f5e7806ba80 2024-05-08T21:00:52.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.083+0000 7f5e75d9b700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5e58066730 0x7f5e58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:00:52.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.083+0000 7f5e75d9b700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5e58066730 0x7f5e58068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5e7815abc0 tx=0x7f5e6c007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:00:52.093 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.087+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f5e68050810 con 0x7f5e7806ba80 2024-05-08T21:00:52.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.255+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e780ad810 con 0x7f5e58066730 2024-05-08T21:00:52.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.267+0000 7f5e66ffd700 1 -- 172.21.15.107:0/844113664 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286751 (secure 0 0 0) 0x7f5e780ad810 con 0x7f5e58066730 2024-05-08T21:00:52.278 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:00:52.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5e58066730 msgr2=0x7f5e58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5e58066730 0x7f5e58068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5e7815abc0 tx=0x7f5e6c007de0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 msgr2=0x7f5e780b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 0x7f5e780b2710 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c530 tx=0x7f5e6800c840 comp rx=0 tx=0).stop 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 shutdown_connections 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e780adfd0 0x7f5e780ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f5e58066730 0x7f5e58068bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f5e780adbf0 0x7f5e78141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 --2- 172.21.15.107:0/844113664 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e7806ba80 0x7f5e780b2710 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 >> 172.21.15.107:0/844113664 conn(0x7f5e78070960 msgr2=0x7f5e7815c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 shutdown_connections 2024-05-08T21:00:52.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:00:52.275+0000 7f5e7759e700 1 -- 172.21.15.107:0/844113664 wait complete. 2024-05-08T21:00:52.282 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:00:52.297 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-05-08T21:00:50.783041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681242,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3273,"num_write_kb":33978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7274,"ondisk_log_size":7274,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004288"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442989+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T21:00:02.442989+0000","last_peered":"2024-05-08T21:00:02.442989+0000","last_clean":"2024-05-08T21:00:02.442989+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:00:02.442989+0000","last_undegraded":"2024-05-08T21:00:02.442989+0000","last_fullsized":"2024-05-08T21:00:02.442989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438795+0000","last_change":"2024-05-08T20:56:41.797750+0000","last_active":"2024-05-08T21:00:02.438795+0000","last_peered":"2024-05-08T21:00:02.438795+0000","last_clean":"2024-05-08T21:00:02.438795+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:02.438795+0000","last_undegraded":"2024-05-08T21:00:02.438795+0000","last_fullsized":"2024-05-08T21:00:02.438795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438312+0000","last_change":"2024-05-08T20:56:41.795471+0000","last_active":"2024-05-08T21:00:02.438312+0000","last_peered":"2024-05-08T21:00:02.438312+0000","last_clean":"2024-05-08T21:00:02.438312+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:00:02.438312+0000","last_undegraded":"2024-05-08T21:00:02.438312+0000","last_fullsized":"2024-05-08T21:00:02.438312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:30.594673+0000","last_change":"2024-05-08T20:56:41.800600+0000","last_active":"2024-05-08T21:00:30.594673+0000","last_peered":"2024-05-08T21:00:30.594673+0000","last_clean":"2024-05-08T21:00:30.594673+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:00:30.594673+0000","last_undegraded":"2024-05-08T21:00:30.594673+0000","last_fullsized":"2024-05-08T21:00:30.594673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443960+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T21:00:02.443960+0000","last_peered":"2024-05-08T21:00:02.443960+0000","last_clean":"2024-05-08T21:00:02.443960+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:00:02.443960+0000","last_undegraded":"2024-05-08T21:00:02.443960+0000","last_fullsized":"2024-05-08T21:00:02.443960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.449413+0000","last_change":"2024-05-08T20:56:41.809460+0000","last_active":"2024-05-08T21:00:02.449413+0000","last_peered":"2024-05-08T21:00:02.449413+0000","last_clean":"2024-05-08T21:00:02.449413+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:00:02.449413+0000","last_undegraded":"2024-05-08T21:00:02.449413+0000","last_fullsized":"2024-05-08T21:00:02.449413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442829+0000","last_change":"2024-05-08T20:56:41.800129+0000","last_active":"2024-05-08T21:00:02.442829+0000","last_peered":"2024-05-08T21:00:02.442829+0000","last_clean":"2024-05-08T21:00:02.442829+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:00:02.442829+0000","last_undegraded":"2024-05-08T21:00:02.442829+0000","last_fullsized":"2024-05-08T21:00:02.442829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443496+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T21:00:02.443496+0000","last_peered":"2024-05-08T21:00:02.443496+0000","last_clean":"2024-05-08T21:00:02.443496+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:00:02.443496+0000","last_undegraded":"2024-05-08T21:00:02.443496+0000","last_fullsized":"2024-05-08T21:00:02.443496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446949+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T21:00:02.446949+0000","last_peered":"2024-05-08T21:00:02.446949+0000","last_clean":"2024-05-08T21:00:02.446949+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:00:02.446949+0000","last_undegraded":"2024-05-08T21:00:02.446949+0000","last_fullsized":"2024-05-08T21:00:02.446949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441867+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T21:00:02.441867+0000","last_peered":"2024-05-08T21:00:02.441867+0000","last_clean":"2024-05-08T21:00:02.441867+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:00:02.441867+0000","last_undegraded":"2024-05-08T21:00:02.441867+0000","last_fullsized":"2024-05-08T21:00:02.441867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441852+0000","last_change":"2024-05-08T20:56:41.805132+0000","last_active":"2024-05-08T21:00:02.441852+0000","last_peered":"2024-05-08T21:00:02.441852+0000","last_clean":"2024-05-08T21:00:02.441852+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:02.441852+0000","last_undegraded":"2024-05-08T21:00:02.441852+0000","last_fullsized":"2024-05-08T21:00:02.441852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.427011+0000","last_change":"2024-05-08T20:56:41.808004+0000","last_active":"2024-05-08T21:00:02.427011+0000","last_peered":"2024-05-08T21:00:02.427011+0000","last_clean":"2024-05-08T21:00:02.427011+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:02.427011+0000","last_undegraded":"2024-05-08T21:00:02.427011+0000","last_fullsized":"2024-05-08T21:00:02.427011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.440633+0000","last_change":"2024-05-08T20:56:41.799122+0000","last_active":"2024-05-08T21:00:02.440633+0000","last_peered":"2024-05-08T21:00:02.440633+0000","last_clean":"2024-05-08T21:00:02.440633+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:02.440633+0000","last_undegraded":"2024-05-08T21:00:02.440633+0000","last_fullsized":"2024-05-08T21:00:02.440633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437691+0000","last_change":"2024-05-08T20:56:41.788789+0000","last_active":"2024-05-08T21:00:02.437691+0000","last_peered":"2024-05-08T21:00:02.437691+0000","last_clean":"2024-05-08T21:00:02.437691+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:02.437691+0000","last_undegraded":"2024-05-08T21:00:02.437691+0000","last_fullsized":"2024-05-08T21:00:02.437691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.424000+0000","last_change":"2024-05-08T20:56:41.810914+0000","last_active":"2024-05-08T21:00:02.424000+0000","last_peered":"2024-05-08T21:00:02.424000+0000","last_clean":"2024-05-08T21:00:02.424000+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:02.424000+0000","last_undegraded":"2024-05-08T21:00:02.424000+0000","last_fullsized":"2024-05-08T21:00:02.424000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438583+0000","last_change":"2024-05-08T20:57:23.947280+0000","last_active":"2024-05-08T21:00:02.438583+0000","last_peered":"2024-05-08T21:00:02.438583+0000","last_clean":"2024-05-08T21:00:02.438583+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:02.438583+0000","last_undegraded":"2024-05-08T21:00:02.438583+0000","last_fullsized":"2024-05-08T21:00:02.438583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447261+0000","last_change":"2024-05-08T20:56:41.805080+0000","last_active":"2024-05-08T21:00:02.447261+0000","last_peered":"2024-05-08T21:00:02.447261+0000","last_clean":"2024-05-08T21:00:02.447261+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:02.447261+0000","last_undegraded":"2024-05-08T21:00:02.447261+0000","last_fullsized":"2024-05-08T21:00:02.447261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.435421+0000","last_change":"2024-05-08T20:56:41.792466+0000","last_active":"2024-05-08T21:00:02.435421+0000","last_peered":"2024-05-08T21:00:02.435421+0000","last_clean":"2024-05-08T21:00:02.435421+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:02.435421+0000","last_undegraded":"2024-05-08T21:00:02.435421+0000","last_fullsized":"2024-05-08T21:00:02.435421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.429848+0000","last_change":"2024-05-08T20:57:23.938502+0000","last_active":"2024-05-08T21:00:02.429848+0000","last_peered":"2024-05-08T21:00:02.429848+0000","last_clean":"2024-05-08T21:00:02.429848+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:00:02.429848+0000","last_undegraded":"2024-05-08T21:00:02.429848+0000","last_fullsized":"2024-05-08T21:00:02.429848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433326+0000","last_change":"2024-05-08T20:56:41.811078+0000","last_active":"2024-05-08T21:00:02.433326+0000","last_peered":"2024-05-08T21:00:02.433326+0000","last_clean":"2024-05-08T21:00:02.433326+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:02.433326+0000","last_undegraded":"2024-05-08T21:00:02.433326+0000","last_fullsized":"2024-05-08T21:00:02.433326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443484+0000","last_change":"2024-05-08T20:56:41.795937+0000","last_active":"2024-05-08T21:00:02.443484+0000","last_peered":"2024-05-08T21:00:02.443484+0000","last_clean":"2024-05-08T21:00:02.443484+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:00:02.443484+0000","last_undegraded":"2024-05-08T21:00:02.443484+0000","last_fullsized":"2024-05-08T21:00:02.443484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.448245+0000","last_change":"2024-05-08T20:56:41.808940+0000","last_active":"2024-05-08T21:00:02.448245+0000","last_peered":"2024-05-08T21:00:02.448245+0000","last_clean":"2024-05-08T21:00:02.448245+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:00:02.448245+0000","last_undegraded":"2024-05-08T21:00:02.448245+0000","last_fullsized":"2024-05-08T21:00:02.448245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.430276+0000","last_change":"2024-05-08T20:56:41.810901+0000","last_active":"2024-05-08T21:00:02.430276+0000","last_peered":"2024-05-08T21:00:02.430276+0000","last_clean":"2024-05-08T21:00:02.430276+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:02.430276+0000","last_undegraded":"2024-05-08T21:00:02.430276+0000","last_fullsized":"2024-05-08T21:00:02.430276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.398661+0000","last_change":"2024-05-08T21:00:41.399039+0000","last_active":"2024-05-08T21:00:41.398661+0000","last_peered":"2024-05-08T21:00:41.398661+0000","last_clean":"2024-05-08T21:00:41.398661+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:41.398661+0000","last_undegraded":"2024-05-08T21:00:41.398661+0000","last_fullsized":"2024-05-08T21:00:41.398661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.398563+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:04.003149+0000","scrub_duration":0.003734036,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.655156+0000","last_change":"2024-05-08T21:00:47.655428+0000","last_active":"2024-05-08T21:00:47.655156+0000","last_peered":"2024-05-08T21:00:47.655156+0000","last_clean":"2024-05-08T21:00:47.655156+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:47.655156+0000","last_undegraded":"2024-05-08T21:00:47.655156+0000","last_fullsized":"2024-05-08T21:00:47.655156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.655055+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:27.532790+0000","scrub_duration":0.0034201549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444555+0000","last_change":"2024-05-08T20:56:41.797403+0000","last_active":"2024-05-08T21:00:02.444555+0000","last_peered":"2024-05-08T21:00:02.444555+0000","last_clean":"2024-05-08T21:00:02.444555+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:00:02.444555+0000","last_undegraded":"2024-05-08T21:00:02.444555+0000","last_fullsized":"2024-05-08T21:00:02.444555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.775463+0000","last_change":"2024-05-08T21:00:47.775760+0000","last_active":"2024-05-08T21:00:47.775463+0000","last_peered":"2024-05-08T21:00:47.775463+0000","last_clean":"2024-05-08T21:00:47.775463+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:47.775463+0000","last_undegraded":"2024-05-08T21:00:47.775463+0000","last_fullsized":"2024-05-08T21:00:47.775463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.775408+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:30.861163+0000","scrub_duration":0.0029691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428265+0000","last_change":"2024-05-08T20:57:23.945199+0000","last_active":"2024-05-08T21:00:02.428265+0000","last_peered":"2024-05-08T21:00:02.428265+0000","last_clean":"2024-05-08T21:00:02.428265+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:00:02.428265+0000","last_undegraded":"2024-05-08T21:00:02.428265+0000","last_fullsized":"2024-05-08T21:00:02.428265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439072+0000","last_change":"2024-05-08T20:56:41.794735+0000","last_active":"2024-05-08T21:00:02.439072+0000","last_peered":"2024-05-08T21:00:02.439072+0000","last_clean":"2024-05-08T21:00:02.439072+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:00:02.439072+0000","last_undegraded":"2024-05-08T21:00:02.439072+0000","last_fullsized":"2024-05-08T21:00:02.439072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.447270+0000","last_change":"2024-05-08T20:56:41.801945+0000","last_active":"2024-05-08T21:00:02.447270+0000","last_peered":"2024-05-08T21:00:02.447270+0000","last_clean":"2024-05-08T21:00:02.447270+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:00:02.447270+0000","last_undegraded":"2024-05-08T21:00:02.447270+0000","last_fullsized":"2024-05-08T21:00:02.447270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444787+0000","last_change":"2024-05-08T20:56:41.793775+0000","last_active":"2024-05-08T21:00:02.444787+0000","last_peered":"2024-05-08T21:00:02.444787+0000","last_clean":"2024-05-08T21:00:02.444787+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:02.444787+0000","last_undegraded":"2024-05-08T21:00:02.444787+0000","last_fullsized":"2024-05-08T21:00:02.444787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442570+0000","last_change":"2024-05-08T20:56:41.799557+0000","last_active":"2024-05-08T21:00:02.442570+0000","last_peered":"2024-05-08T21:00:02.442570+0000","last_clean":"2024-05-08T21:00:02.442570+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:02.442570+0000","last_undegraded":"2024-05-08T21:00:02.442570+0000","last_fullsized":"2024-05-08T21:00:02.442570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428830+0000","last_change":"2024-05-08T20:56:41.806410+0000","last_active":"2024-05-08T21:00:02.428830+0000","last_peered":"2024-05-08T21:00:02.428830+0000","last_clean":"2024-05-08T21:00:02.428830+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:02.428830+0000","last_undegraded":"2024-05-08T21:00:02.428830+0000","last_fullsized":"2024-05-08T21:00:02.428830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1518","reported_seq":1544,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:37.726255+0000","last_change":"2024-05-08T21:00:37.726489+0000","last_active":"2024-05-08T21:00:37.726255+0000","last_peered":"2024-05-08T21:00:37.726255+0000","last_clean":"2024-05-08T21:00:37.726255+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T21:00:37.726255+0000","last_undegraded":"2024-05-08T21:00:37.726255+0000","last_fullsized":"2024-05-08T21:00:37.726255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1518","last_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_deep_scrub":"22'1518","last_deep_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_clean_scrub_stamp":"2024-05-08T21:00:37.726200+0000","objects_scrubbed":1,"log_size":1518,"log_dups_size":0,"ondisk_log_size":1518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:02.621040+0000","scrub_duration":0.020388380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.412337+0000","last_change":"2024-05-08T21:00:44.412664+0000","last_active":"2024-05-08T21:00:44.412337+0000","last_peered":"2024-05-08T21:00:44.412337+0000","last_clean":"2024-05-08T21:00:44.412337+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:44.412337+0000","last_undegraded":"2024-05-08T21:00:44.412337+0000","last_fullsized":"2024-05-08T21:00:44.412337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.412281+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:20.132691+0000","scrub_duration":0.0034358980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'33","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.489280+0000","last_change":"2024-05-08T21:00:42.489459+0000","last_active":"2024-05-08T21:00:42.489280+0000","last_peered":"2024-05-08T21:00:42.489280+0000","last_clean":"2024-05-08T21:00:42.489280+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T21:00:42.489280+0000","last_undegraded":"2024-05-08T21:00:42.489280+0000","last_fullsized":"2024-05-08T21:00:42.489280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.489252+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:07.384093+0000","scrub_duration":0.014418689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.675789+0000","last_change":"2024-05-08T21:00:34.676171+0000","last_active":"2024-05-08T21:00:34.675789+0000","last_peered":"2024-05-08T21:00:34.675789+0000","last_clean":"2024-05-08T21:00:34.675789+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T21:00:34.675789+0000","last_undegraded":"2024-05-08T21:00:34.675789+0000","last_fullsized":"2024-05-08T21:00:34.675789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.675671+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:11.978147+0000","scrub_duration":0.0039060010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.437944+0000","last_change":"2024-05-08T20:56:41.800377+0000","last_active":"2024-05-08T21:00:02.437944+0000","last_peered":"2024-05-08T21:00:02.437944+0000","last_clean":"2024-05-08T21:00:02.437944+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:00:02.437944+0000","last_undegraded":"2024-05-08T21:00:02.437944+0000","last_fullsized":"2024-05-08T21:00:02.437944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.444170+0000","last_change":"2024-05-08T21:00:33.444544+0000","last_active":"2024-05-08T21:00:33.444170+0000","last_peered":"2024-05-08T21:00:33.444170+0000","last_clean":"2024-05-08T21:00:33.444170+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T21:00:33.444170+0000","last_undegraded":"2024-05-08T21:00:33.444170+0000","last_fullsized":"2024-05-08T21:00:33.444170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.444064+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:58.392198+0000","scrub_duration":0.0033063799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.434476+0000","last_change":"2024-05-08T20:56:41.795063+0000","last_active":"2024-05-08T21:00:02.434476+0000","last_peered":"2024-05-08T21:00:02.434476+0000","last_clean":"2024-05-08T21:00:02.434476+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:02.434476+0000","last_undegraded":"2024-05-08T21:00:02.434476+0000","last_fullsized":"2024-05-08T21:00:02.434476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:01.184700+0000","last_change":"2024-05-08T20:56:41.408678+0000","last_active":"2024-05-08T21:00:01.184700+0000","last_peered":"2024-05-08T21:00:01.184700+0000","last_clean":"2024-05-08T21:00:01.184700+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T21:00:01.184700+0000","last_undegraded":"2024-05-08T21:00:01.184700+0000","last_fullsized":"2024-05-08T21:00:01.184700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.292522+0000","last_change":"2024-05-08T21:00:44.292926+0000","last_active":"2024-05-08T21:00:44.292522+0000","last_peered":"2024-05-08T21:00:44.292522+0000","last_clean":"2024-05-08T21:00:44.292522+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:44.292522+0000","last_undegraded":"2024-05-08T21:00:44.292522+0000","last_fullsized":"2024-05-08T21:00:44.292522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'73","last_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_deep_scrub":"22'73","last_deep_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.292418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:33.251483+0000","scrub_duration":0.003408847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.368845+0000","last_change":"2024-05-08T21:00:39.369186+0000","last_active":"2024-05-08T21:00:39.368845+0000","last_peered":"2024-05-08T21:00:39.368845+0000","last_clean":"2024-05-08T21:00:39.368845+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T21:00:39.368845+0000","last_undegraded":"2024-05-08T21:00:39.368845+0000","last_fullsized":"2024-05-08T21:00:39.368845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.368784+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:19.422507+0000","scrub_duration":0.003438361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445430+0000","last_change":"2024-05-08T20:56:41.793990+0000","last_active":"2024-05-08T21:00:02.445430+0000","last_peered":"2024-05-08T21:00:02.445430+0000","last_clean":"2024-05-08T21:00:02.445430+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:02.445430+0000","last_undegraded":"2024-05-08T21:00:02.445430+0000","last_fullsized":"2024-05-08T21:00:02.445430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.813390+0000","last_change":"2024-05-08T21:00:45.813637+0000","last_active":"2024-05-08T21:00:45.813390+0000","last_peered":"2024-05-08T21:00:45.813390+0000","last_clean":"2024-05-08T21:00:45.813390+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:45.813390+0000","last_undegraded":"2024-05-08T21:00:45.813390+0000","last_fullsized":"2024-05-08T21:00:45.813390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.813341+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:25.240476+0000","scrub_duration":0.0080349970000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.645222+0000","last_change":"2024-05-08T21:00:47.645482+0000","last_active":"2024-05-08T21:00:47.645222+0000","last_peered":"2024-05-08T21:00:47.645222+0000","last_clean":"2024-05-08T21:00:47.645222+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:47.645222+0000","last_undegraded":"2024-05-08T21:00:47.645222+0000","last_fullsized":"2024-05-08T21:00:47.645222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.645171+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:08.126340+0000","scrub_duration":0.003615516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'916","reported_seq":942,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.539135+0000","last_change":"2024-05-08T21:00:43.539407+0000","last_active":"2024-05-08T21:00:43.539135+0000","last_peered":"2024-05-08T21:00:43.539135+0000","last_clean":"2024-05-08T21:00:43.539135+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T21:00:43.539135+0000","last_undegraded":"2024-05-08T21:00:43.539135+0000","last_fullsized":"2024-05-08T21:00:43.539135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'916","last_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_deep_scrub":"22'916","last_deep_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.539080+0000","objects_scrubbed":4,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:19.259490+0000","scrub_duration":0.023469797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442994+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442994+0000","last_peered":"2024-05-08T21:00:02.442994+0000","last_clean":"2024-05-08T21:00:02.442994+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442994+0000","last_undegraded":"2024-05-08T21:00:02.442994+0000","last_fullsized":"2024-05-08T21:00:02.442994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'19","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.416238+0000","last_change":"2024-05-08T21:00:38.416562+0000","last_active":"2024-05-08T21:00:38.416238+0000","last_peered":"2024-05-08T21:00:38.416238+0000","last_clean":"2024-05-08T21:00:38.416238+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T21:00:38.416238+0000","last_undegraded":"2024-05-08T21:00:38.416238+0000","last_fullsized":"2024-05-08T21:00:38.416238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.416185+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:32.961167+0000","scrub_duration":0.0073912780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.411023+0000","last_change":"2024-05-08T21:00:42.411400+0000","last_active":"2024-05-08T21:00:42.411023+0000","last_peered":"2024-05-08T21:00:42.411023+0000","last_clean":"2024-05-08T21:00:42.411023+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:42.411023+0000","last_undegraded":"2024-05-08T21:00:42.411023+0000","last_fullsized":"2024-05-08T21:00:42.411023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.410909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:52.782534+0000","scrub_duration":0.0037112960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.350327+0000","last_change":"2024-05-08T21:00:40.350668+0000","last_active":"2024-05-08T21:00:40.350327+0000","last_peered":"2024-05-08T21:00:40.350327+0000","last_clean":"2024-05-08T21:00:40.350327+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T21:00:40.350327+0000","last_undegraded":"2024-05-08T21:00:40.350327+0000","last_fullsized":"2024-05-08T21:00:40.350327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.350213+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:19.777348+0000","scrub_duration":0.0036910760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444234+0000","last_change":"2024-05-08T20:56:41.808168+0000","last_active":"2024-05-08T21:00:02.444234+0000","last_peered":"2024-05-08T21:00:02.444234+0000","last_clean":"2024-05-08T21:00:02.444234+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:00:02.444234+0000","last_undegraded":"2024-05-08T21:00:02.444234+0000","last_fullsized":"2024-05-08T21:00:02.444234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.424531+0000","last_change":"2024-05-08T21:00:40.424776+0000","last_active":"2024-05-08T21:00:40.424531+0000","last_peered":"2024-05-08T21:00:40.424531+0000","last_clean":"2024-05-08T21:00:40.424531+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T21:00:40.424531+0000","last_undegraded":"2024-05-08T21:00:40.424531+0000","last_fullsized":"2024-05-08T21:00:40.424531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'30","last_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_deep_scrub":"22'30","last_deep_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.424482+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:18.189346+0000","scrub_duration":0.003259638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438113+0000","last_change":"2024-05-08T20:56:41.799104+0000","last_active":"2024-05-08T21:00:02.438113+0000","last_peered":"2024-05-08T21:00:02.438113+0000","last_clean":"2024-05-08T21:00:02.438113+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:02.438113+0000","last_undegraded":"2024-05-08T21:00:02.438113+0000","last_fullsized":"2024-05-08T21:00:02.438113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'36","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.803315+0000","last_change":"2024-05-08T21:00:42.803499+0000","last_active":"2024-05-08T21:00:42.803315+0000","last_peered":"2024-05-08T21:00:42.803315+0000","last_clean":"2024-05-08T21:00:42.803315+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T21:00:42.803315+0000","last_undegraded":"2024-05-08T21:00:42.803315+0000","last_fullsized":"2024-05-08T21:00:42.803315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.803281+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:03.284450+0000","scrub_duration":0.013360945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:31.918167+0000","last_change":"2024-05-08T21:00:31.918445+0000","last_active":"2024-05-08T21:00:31.918167+0000","last_peered":"2024-05-08T21:00:31.918167+0000","last_clean":"2024-05-08T21:00:31.918167+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:31.918167+0000","last_undegraded":"2024-05-08T21:00:31.918167+0000","last_fullsized":"2024-05-08T21:00:31.918167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_clean_scrub_stamp":"2024-05-08T21:00:31.918115+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:56.866249+0000","scrub_duration":0.0031224640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.691240+0000","last_change":"2024-05-08T21:00:46.691488+0000","last_active":"2024-05-08T21:00:46.691240+0000","last_peered":"2024-05-08T21:00:46.691240+0000","last_clean":"2024-05-08T21:00:46.691240+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T21:00:46.691240+0000","last_undegraded":"2024-05-08T21:00:46.691240+0000","last_fullsized":"2024-05-08T21:00:46.691240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.691190+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:41.236171+0000","scrub_duration":0.007003202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442903+0000","last_change":"2024-05-08T20:56:41.807430+0000","last_active":"2024-05-08T21:00:02.442903+0000","last_peered":"2024-05-08T21:00:02.442903+0000","last_clean":"2024-05-08T21:00:02.442903+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:02.442903+0000","last_undegraded":"2024-05-08T21:00:02.442903+0000","last_fullsized":"2024-05-08T21:00:02.442903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'21","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.853958+0000","last_change":"2024-05-08T21:00:47.854245+0000","last_active":"2024-05-08T21:00:47.853958+0000","last_peered":"2024-05-08T21:00:47.853958+0000","last_clean":"2024-05-08T21:00:47.853958+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T21:00:47.853958+0000","last_undegraded":"2024-05-08T21:00:47.853958+0000","last_fullsized":"2024-05-08T21:00:47.853958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.853909+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.574319+0000","scrub_duration":0.0059207569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445486+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T21:00:02.445486+0000","last_peered":"2024-05-08T21:00:02.445486+0000","last_clean":"2024-05-08T21:00:02.445486+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:00:02.445486+0000","last_undegraded":"2024-05-08T21:00:02.445486+0000","last_fullsized":"2024-05-08T21:00:02.445486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'25","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.771047+0000","last_change":"2024-05-08T21:00:33.771270+0000","last_active":"2024-05-08T21:00:33.771047+0000","last_peered":"2024-05-08T21:00:33.771047+0000","last_clean":"2024-05-08T21:00:33.771047+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T21:00:33.771047+0000","last_undegraded":"2024-05-08T21:00:33.771047+0000","last_fullsized":"2024-05-08T21:00:33.771047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.771004+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.252173+0000","scrub_duration":0.006918853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442066+0000","last_change":"2024-05-08T20:56:41.800750+0000","last_active":"2024-05-08T21:00:02.442066+0000","last_peered":"2024-05-08T21:00:02.442066+0000","last_clean":"2024-05-08T21:00:02.442066+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:02.442066+0000","last_undegraded":"2024-05-08T21:00:02.442066+0000","last_fullsized":"2024-05-08T21:00:02.442066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.796029+0000","last_change":"2024-05-08T21:00:41.796298+0000","last_active":"2024-05-08T21:00:41.796029+0000","last_peered":"2024-05-08T21:00:41.796029+0000","last_clean":"2024-05-08T21:00:41.796029+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T21:00:41.796029+0000","last_undegraded":"2024-05-08T21:00:41.796029+0000","last_fullsized":"2024-05-08T21:00:41.796029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'29","last_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_deep_scrub":"22'29","last_deep_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.795973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:36.340955+0000","scrub_duration":0.003348916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443048+0000","last_change":"2024-05-08T20:57:23.939637+0000","last_active":"2024-05-08T21:00:02.443048+0000","last_peered":"2024-05-08T21:00:02.443048+0000","last_clean":"2024-05-08T21:00:02.443048+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:00:02.443048+0000","last_undegraded":"2024-05-08T21:00:02.443048+0000","last_fullsized":"2024-05-08T21:00:02.443048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.002791+0000","last_change":"2024-05-08T21:00:40.003115+0000","last_active":"2024-05-08T21:00:40.002791+0000","last_peered":"2024-05-08T21:00:40.002791+0000","last_clean":"2024-05-08T21:00:40.002791+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T21:00:40.002791+0000","last_undegraded":"2024-05-08T21:00:40.002791+0000","last_fullsized":"2024-05-08T21:00:40.002791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.002743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:04.204746+0000","scrub_duration":0.010423897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.434485+0000","last_change":"2024-05-08T21:00:34.434755+0000","last_active":"2024-05-08T21:00:34.434485+0000","last_peered":"2024-05-08T21:00:34.434485+0000","last_clean":"2024-05-08T21:00:34.434485+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T21:00:34.434485+0000","last_undegraded":"2024-05-08T21:00:34.434485+0000","last_fullsized":"2024-05-08T21:00:34.434485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.434434+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:09.727644+0000","scrub_duration":0.0038574659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445497+0000","last_change":"2024-05-08T20:57:23.937184+0000","last_active":"2024-05-08T21:00:02.445497+0000","last_peered":"2024-05-08T21:00:02.445497+0000","last_clean":"2024-05-08T21:00:02.445497+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:02.445497+0000","last_undegraded":"2024-05-08T21:00:02.445497+0000","last_fullsized":"2024-05-08T21:00:02.445497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.042986+0000","last_change":"2024-05-08T21:00:42.042986+0000","last_active":"2024-05-08T21:00:42.042986+0000","last_peered":"2024-05-08T21:00:42.042986+0000","last_clean":"2024-05-08T21:00:42.042986+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T21:00:42.042986+0000","last_undegraded":"2024-05-08T21:00:42.042986+0000","last_fullsized":"2024-05-08T21:00:42.042986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.042532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:21.469667+0000","scrub_duration":0.0045502980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.438195+0000","last_change":"2024-05-08T20:56:41.810993+0000","last_active":"2024-05-08T21:00:02.438195+0000","last_peered":"2024-05-08T21:00:02.438195+0000","last_clean":"2024-05-08T21:00:02.438195+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:02.438195+0000","last_undegraded":"2024-05-08T21:00:02.438195+0000","last_fullsized":"2024-05-08T21:00:02.438195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'74","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.857894+0000","last_change":"2024-05-08T21:00:45.858180+0000","last_active":"2024-05-08T21:00:45.857894+0000","last_peered":"2024-05-08T21:00:45.857894+0000","last_clean":"2024-05-08T21:00:45.857894+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:45.857894+0000","last_undegraded":"2024-05-08T21:00:45.857894+0000","last_fullsized":"2024-05-08T21:00:45.857894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'74","last_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_deep_scrub":"22'74","last_deep_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.857839+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:56.229464+0000","scrub_duration":0.0081842159999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:28.644781+0000","last_change":"2024-05-08T20:56:41.798404+0000","last_active":"2024-05-08T21:00:28.644781+0000","last_peered":"2024-05-08T21:00:28.644781+0000","last_clean":"2024-05-08T21:00:28.644781+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:00:28.644781+0000","last_undegraded":"2024-05-08T21:00:28.644781+0000","last_fullsized":"2024-05-08T21:00:28.644781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.478912+0000","last_change":"2024-05-08T21:00:32.479144+0000","last_active":"2024-05-08T21:00:32.478912+0000","last_peered":"2024-05-08T21:00:32.478912+0000","last_clean":"2024-05-08T21:00:32.478912+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T21:00:32.478912+0000","last_undegraded":"2024-05-08T21:00:32.478912+0000","last_fullsized":"2024-05-08T21:00:32.478912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.478860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:42.850485+0000","scrub_duration":0.0033808480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.439429+0000","last_change":"2024-05-08T20:56:41.806995+0000","last_active":"2024-05-08T21:00:02.439429+0000","last_peered":"2024-05-08T21:00:02.439429+0000","last_clean":"2024-05-08T21:00:02.439429+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:02.439429+0000","last_undegraded":"2024-05-08T21:00:02.439429+0000","last_fullsized":"2024-05-08T21:00:02.439429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:36.678095+0000","last_change":"2024-05-08T21:00:36.678387+0000","last_active":"2024-05-08T21:00:36.678095+0000","last_peered":"2024-05-08T21:00:36.678095+0000","last_clean":"2024-05-08T21:00:36.678095+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T21:00:36.678095+0000","last_undegraded":"2024-05-08T21:00:36.678095+0000","last_fullsized":"2024-05-08T21:00:36.678095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'22","last_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_deep_scrub":"22'22","last_deep_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_clean_scrub_stamp":"2024-05-08T21:00:36.678044+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:47.049669+0000","scrub_duration":0.0036330770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.352758+0000","last_change":"2024-05-08T21:00:42.353197+0000","last_active":"2024-05-08T21:00:42.352758+0000","last_peered":"2024-05-08T21:00:42.352758+0000","last_clean":"2024-05-08T21:00:42.352758+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:42.352758+0000","last_undegraded":"2024-05-08T21:00:42.352758+0000","last_fullsized":"2024-05-08T21:00:42.352758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.352656+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:25.438411+0000","scrub_duration":0.003835003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.092987+0000","last_change":"2024-05-08T21:00:44.093337+0000","last_active":"2024-05-08T21:00:44.092987+0000","last_peered":"2024-05-08T21:00:44.092987+0000","last_clean":"2024-05-08T21:00:44.092987+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T21:00:44.092987+0000","last_undegraded":"2024-05-08T21:00:44.092987+0000","last_fullsized":"2024-05-08T21:00:44.092987+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.092882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:27.178637+0000","scrub_duration":0.0040887049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.787896+0000","last_change":"2024-05-08T21:00:46.788249+0000","last_active":"2024-05-08T21:00:46.787896+0000","last_peered":"2024-05-08T21:00:46.787896+0000","last_clean":"2024-05-08T21:00:46.787896+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:46.787896+0000","last_undegraded":"2024-05-08T21:00:46.787896+0000","last_fullsized":"2024-05-08T21:00:46.787896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.787793+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:09.392379+0000","scrub_duration":0.0034348349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'41","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.787890+0000","last_change":"2024-05-08T21:00:44.788225+0000","last_active":"2024-05-08T21:00:44.787890+0000","last_peered":"2024-05-08T21:00:44.787890+0000","last_clean":"2024-05-08T21:00:44.787890+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:44.787890+0000","last_undegraded":"2024-05-08T21:00:44.787890+0000","last_fullsized":"2024-05-08T21:00:44.787890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.787841+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:24.841564+0000","scrub_duration":0.0082866180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.683434+0000","last_change":"2024-05-08T21:00:39.683673+0000","last_active":"2024-05-08T21:00:39.683434+0000","last_peered":"2024-05-08T21:00:39.683434+0000","last_clean":"2024-05-08T21:00:39.683434+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:39.683434+0000","last_undegraded":"2024-05-08T21:00:39.683434+0000","last_fullsized":"2024-05-08T21:00:39.683434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.683380+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:14.976590+0000","scrub_duration":0.003306767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'27","reported_seq":53,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.384310+0000","last_change":"2024-05-08T21:00:39.384556+0000","last_active":"2024-05-08T21:00:39.384310+0000","last_peered":"2024-05-08T21:00:39.384310+0000","last_clean":"2024-05-08T21:00:39.384310+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:39.384310+0000","last_undegraded":"2024-05-08T21:00:39.384310+0000","last_fullsized":"2024-05-08T21:00:39.384310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'27","last_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_deep_scrub":"22'27","last_deep_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.384259+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:16.686736+0000","scrub_duration":0.0058410570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.433960+0000","last_change":"2024-05-08T20:56:41.795217+0000","last_active":"2024-05-08T21:00:02.433960+0000","last_peered":"2024-05-08T21:00:02.433960+0000","last_clean":"2024-05-08T21:00:02.433960+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:02.433960+0000","last_undegraded":"2024-05-08T21:00:02.433960+0000","last_fullsized":"2024-05-08T21:00:02.433960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T20:59:50.203486+0000","last_change":"2024-05-08T20:56:41.421146+0000","last_active":"2024-05-08T20:59:50.203486+0000","last_peered":"2024-05-08T20:59:50.203486+0000","last_clean":"2024-05-08T20:59:50.203486+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T20:59:50.203486+0000","last_undegraded":"2024-05-08T20:59:50.203486+0000","last_fullsized":"2024-05-08T20:59:50.203486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.427759+0000","last_change":"2024-05-08T20:56:41.806270+0000","last_active":"2024-05-08T21:00:02.427759+0000","last_peered":"2024-05-08T21:00:02.427759+0000","last_clean":"2024-05-08T21:00:02.427759+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:02.427759+0000","last_undegraded":"2024-05-08T21:00:02.427759+0000","last_fullsized":"2024-05-08T21:00:02.427759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.718917+0000","last_change":"2024-05-08T21:00:32.719141+0000","last_active":"2024-05-08T21:00:32.718917+0000","last_peered":"2024-05-08T21:00:32.718917+0000","last_clean":"2024-05-08T21:00:32.718917+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T21:00:32.718917+0000","last_undegraded":"2024-05-08T21:00:32.718917+0000","last_fullsized":"2024-05-08T21:00:32.718917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.718866+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:27.263848+0000","scrub_duration":0.0035823880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431077+0000","last_change":"2024-05-08T20:56:41.800573+0000","last_active":"2024-05-08T21:00:02.431077+0000","last_peered":"2024-05-08T21:00:02.431077+0000","last_clean":"2024-05-08T21:00:02.431077+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:00:02.431077+0000","last_undegraded":"2024-05-08T21:00:02.431077+0000","last_fullsized":"2024-05-08T21:00:02.431077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.673502+0000","last_change":"2024-05-08T21:00:38.673744+0000","last_active":"2024-05-08T21:00:38.673502+0000","last_peered":"2024-05-08T21:00:38.673502+0000","last_clean":"2024-05-08T21:00:38.673502+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T21:00:38.673502+0000","last_undegraded":"2024-05-08T21:00:38.673502+0000","last_fullsized":"2024-05-08T21:00:38.673502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'31","last_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_deep_scrub":"22'31","last_deep_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.673453+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:14.393863+0000","scrub_duration":0.0031815139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.654744+0000","last_change":"2024-05-08T21:00:45.654995+0000","last_active":"2024-05-08T21:00:45.654744+0000","last_peered":"2024-05-08T21:00:45.654744+0000","last_clean":"2024-05-08T21:00:45.654744+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:45.654744+0000","last_undegraded":"2024-05-08T21:00:45.654744+0000","last_fullsized":"2024-05-08T21:00:45.654744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.654690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:09.856693+0000","scrub_duration":0.0034274710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'520","reported_seq":546,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.091128+0000","last_change":"2024-05-08T21:00:43.091282+0000","last_active":"2024-05-08T21:00:43.091128+0000","last_peered":"2024-05-08T21:00:43.091128+0000","last_clean":"2024-05-08T21:00:43.091128+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T21:00:43.091128+0000","last_undegraded":"2024-05-08T21:00:43.091128+0000","last_fullsized":"2024-05-08T21:00:43.091128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'520","last_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_deep_scrub":"22'520","last_deep_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.091097+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:05.695683+0000","scrub_duration":0.019677249000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.431823+0000","last_change":"2024-05-08T20:56:41.811079+0000","last_active":"2024-05-08T21:00:02.431823+0000","last_peered":"2024-05-08T21:00:02.431823+0000","last_clean":"2024-05-08T21:00:02.431823+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:02.431823+0000","last_undegraded":"2024-05-08T21:00:02.431823+0000","last_fullsized":"2024-05-08T21:00:02.431823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.444241+0000","last_change":"2024-05-08T20:57:23.945794+0000","last_active":"2024-05-08T21:00:02.444241+0000","last_peered":"2024-05-08T21:00:02.444241+0000","last_clean":"2024-05-08T21:00:02.444241+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:02.444241+0000","last_undegraded":"2024-05-08T21:00:02.444241+0000","last_fullsized":"2024-05-08T21:00:02.444241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'17","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.090009+0000","last_change":"2024-05-08T21:00:46.090256+0000","last_active":"2024-05-08T21:00:46.090009+0000","last_peered":"2024-05-08T21:00:46.090009+0000","last_clean":"2024-05-08T21:00:46.090009+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T21:00:46.090009+0000","last_undegraded":"2024-05-08T21:00:46.090009+0000","last_fullsized":"2024-05-08T21:00:46.090009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'17","last_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_deep_scrub":"22'17","last_deep_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.089958+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:35.049023+0000","scrub_duration":0.0058691460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.430410+0000","last_change":"2024-05-08T20:57:23.945132+0000","last_active":"2024-05-08T21:00:02.430410+0000","last_peered":"2024-05-08T21:00:02.430410+0000","last_clean":"2024-05-08T21:00:02.430410+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:02.430410+0000","last_undegraded":"2024-05-08T21:00:02.430410+0000","last_fullsized":"2024-05-08T21:00:02.430410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'55","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:24.729912+0000","last_change":"2024-05-08T20:56:41.423190+0000","last_active":"2024-05-08T21:00:24.729912+0000","last_peered":"2024-05-08T21:00:24.729912+0000","last_clean":"2024-05-08T21:00:24.729912+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:24.729912+0000","last_undegraded":"2024-05-08T21:00:24.729912+0000","last_fullsized":"2024-05-08T21:00:24.729912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:40.380872+0000","last_clean_scrub_stamp":"2024-05-08T20:56:40.380872+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445292+0000","last_change":"2024-05-08T20:56:41.794126+0000","last_active":"2024-05-08T21:00:02.445292+0000","last_peered":"2024-05-08T21:00:02.445292+0000","last_clean":"2024-05-08T21:00:02.445292+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:02.445292+0000","last_undegraded":"2024-05-08T21:00:02.445292+0000","last_fullsized":"2024-05-08T21:00:02.445292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'44","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:35.712444+0000","last_change":"2024-05-08T21:00:35.712444+0000","last_active":"2024-05-08T21:00:35.712444+0000","last_peered":"2024-05-08T21:00:35.712444+0000","last_clean":"2024-05-08T21:00:35.712444+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T21:00:35.712444+0000","last_undegraded":"2024-05-08T21:00:35.712444+0000","last_fullsized":"2024-05-08T21:00:35.712444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_clean_scrub_stamp":"2024-05-08T21:00:35.712232+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:13.477096+0000","scrub_duration":0.017292459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:29.625054+0000","last_change":"2024-05-08T20:56:41.799414+0000","last_active":"2024-05-08T21:00:29.625054+0000","last_peered":"2024-05-08T21:00:29.625054+0000","last_clean":"2024-05-08T21:00:29.625054+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:29.625054+0000","last_undegraded":"2024-05-08T21:00:29.625054+0000","last_fullsized":"2024-05-08T21:00:29.625054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'52","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.425129+0000","last_change":"2024-05-08T21:00:39.425346+0000","last_active":"2024-05-08T21:00:39.425129+0000","last_peered":"2024-05-08T21:00:39.425129+0000","last_clean":"2024-05-08T21:00:39.425129+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T21:00:39.425129+0000","last_undegraded":"2024-05-08T21:00:39.425129+0000","last_fullsized":"2024-05-08T21:00:39.425129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.425092+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:59.906261+0000","scrub_duration":0.020912884999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090874,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3114,"num_write_kb":31562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3848,"ondisk_log_size":3848,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.01,"5min":1.22,"15min":1.22},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.56799999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1659999999999999,"5min":1.254,"15min":1.254},"last":0.75600000000000001}]},{"osd":1,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.68000000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.137,"5min":1.298,"15min":1.298},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84999999999999998}]},{"osd":2,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92200000000000004,"15min":0.97099999999999997},"min":{"1min":0.51000000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1719999999999999,"5min":1.274,"15min":1.274},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.96799999999999997,"15min":1.032},"min":{"1min":0.58599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.214,"5min":1.399,"15min":1.399},"last":1.089}]},{"osd":3,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.87},"min":{"1min":0.62,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1890000000000001,"5min":1.319,"15min":1.319},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.01,"15min":1.085},"min":{"1min":0.69999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.25,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0489999999999999}]},{"osd":4,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1890000000000001,"5min":1.425,"15min":1.425},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.02,"15min":1.0649999999999999},"min":{"1min":0.67600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.1220000000000001,"5min":1.397,"15min":1.397},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0329999999999999,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.347,"5min":1.425,"15min":1.425},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.02,"5min":1.0940000000000001,"15min":1.135},"min":{"1min":0.77400000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.734,"15min":1.734},"last":1.159}]},{"osd":6,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.171},"min":{"1min":0.81899999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.286,"5min":1.821,"15min":1.821},"last":1.206},{"interface":"front","average":{"1min":1.095,"5min":1.149,"15min":1.1930000000000001},"min":{"1min":0.83399999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.2609999999999999,"5min":1.45,"15min":1.45},"last":0.99299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14039081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.92200000000000004},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.84799999999999998,"15min":0.91400000000000003},"min":{"1min":0.58599999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.044,"5min":1.343,"15min":1.343},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91200000000000003,"15min":0.98299999999999998},"min":{"1min":0.60299999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":1.02},"min":{"1min":0.68400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2190000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.087}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0609999999999999,"5min":1.163,"15min":1.163},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89400000000000002,"15min":0.92000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.155,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95499999999999996}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.96199999999999997},"min":{"1min":0.68300000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.258,"15min":1.258},"last":0.97999999999999998}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.88800000000000001,"15min":0.90000000000000002},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2609999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3069999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.016}]},{"osd":5,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.117,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":1.0860000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3360000000000001,"5min":1.403,"15min":1.403},"last":1.042}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1100000000000001,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.377,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.083,"15min":1.111},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2310000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.159}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.85199999999999998},"min":{"1min":0.443,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":1.173,"15min":1.173},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.57699999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.137,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.008}]},{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.86099999999999999,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.85599999999999998},"min":{"1min":0.60499999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":1.256},"last":0.86299999999999999}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.879,"15min":0.89500000000000002},"min":{"1min":0.61899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.163,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88400000000000001,"15min":0.92500000000000004},"min":{"1min":0.66800000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.109,"5min":1.401,"15min":1.401},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.65000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0900000000000001,"5min":1.256,"15min":1.256},"last":1.125},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.81799999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1830000000000001,"5min":1.341,"15min":1.341},"last":0.74399999999999999}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.93999999999999995,"15min":0.95899999999999996},"min":{"1min":0.59399999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.175,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.622,"5min":0.505,"15min":0.505},"max":{"1min":1.153,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1930000000000001}]},{"osd":6,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0369999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.256,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.054,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.98799999999999999}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.071,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4119999999999999,"5min":1.423,"15min":1.423},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.139,"15min":1.175},"min":{"1min":0.71999999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3480000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.1499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81200000000000006,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2609999999999999,"5min":1.466,"15min":1.466},"last":1.0920000000000001}]},{"osd":1,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.51900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0609999999999999,"5min":1.292,"15min":1.292},"last":0.878},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90000000000000002,"15min":0.94199999999999995},"min":{"1min":0.57799999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3700000000000001,"5min":1.556,"15min":1.556},"last":0.94699999999999995}]},{"osd":2,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85799999999999998,"15min":0.89000000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.123,"5min":1.264,"15min":1.264},"last":0.92200000000000004}]},{"osd":3,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.91200000000000003,"15min":0.94199999999999995},"min":{"1min":0.746,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3220000000000001,"5min":1.613,"15min":1.613},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2250000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.05}]},{"osd":5,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":1.036},{"interface":"front","average":{"1min":1.194,"5min":1.0820000000000001,"15min":1.0960000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.0700000000000001}]},{"osd":6,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.0449999999999999},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.347,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.036,"5min":0.999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.375,"5min":1.784,"15min":1.784},"last":0.78700000000000003}]},{"osd":7,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0669999999999999,"15min":1.087},"min":{"1min":0.63300000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5529999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.1100000000000001,"15min":1.149},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.419,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.99299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71199999999999997,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":1.109,"15min":1.109},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.72599999999999998},"min":{"1min":0.442,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.47299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89400000000000002,"5min":1.075,"15min":1.075},"last":0.79300000000000004}]},{"osd":2,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.98499999999999999,"5min":1.671,"15min":1.671},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.57399999999999995,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.302,"15min":1.302},"last":0.72399999999999998}]},{"osd":4,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98499999999999999,"15min":1.014},"min":{"1min":0.78300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3200000000000001,"5min":1.522,"15min":1.522},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0369999999999999,"15min":1.052},"min":{"1min":0.65800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.4139999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.99199999999999999}]},{"osd":5,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3859999999999999,"5min":1.994,"15min":1.994},"last":1.3080000000000001},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.048,"15min":1.0940000000000001},"min":{"1min":0.76600000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2649999999999999,"5min":2.198,"15min":2.198},"last":0.84399999999999997}]},{"osd":6,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.069,"15min":1.099},"min":{"1min":0.72299999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.145,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.085,"15min":1.115},"min":{"1min":0.76500000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1759999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.363}]},{"osd":7,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1639999999999999},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1619999999999999},"min":{"1min":0.78800000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.393,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.0640000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85099999999999998,"5min":0.996,"15min":0.996},"last":0.97399999999999998}]},{"osd":1,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.244,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.78400000000000003},"min":{"1min":0.47299999999999998,"5min":0.311,"15min":0.311},"max":{"1min":1.274,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.80900000000000005}]},{"osd":3,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.747},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.014,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.57999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.2310000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.96599999999999997,"15min":0.996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.194,"5min":1.577,"15min":1.577},"last":1.0820000000000001}]},{"osd":5,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":1.0269999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2470000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.008},{"interface":"front","average":{"1min":1.024,"5min":1.036,"15min":1.0589999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.651,"5min":1.8,"15min":1.8},"last":0.92200000000000004}]},{"osd":6,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0029999999999999,"15min":1.0369999999999999},"min":{"1min":0.63700000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.165},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0149999999999999,"15min":1.097},"min":{"1min":0.66100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.155,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.93899999999999995}]},{"osd":7,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0249999999999999,"15min":1.042},"min":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.258,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.234},{"interface":"front","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.1379999999999999},"min":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.113}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.70499999999999996},"min":{"1min":0.42899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.94299999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67500000000000004}]},{"osd":2,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.47899999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0900000000000001,"5min":1.294,"15min":1.294},"last":0.70799999999999996}]},{"osd":3,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.56799999999999995,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.173,"15min":1.173},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1879999999999999,"5min":1.26,"15min":1.26},"last":0.87},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.96199999999999997,"15min":1.0069999999999999},"min":{"1min":0.79400000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.137,"5min":1.901,"15min":1.901},"last":0.82499999999999996}]},{"osd":5,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.024,"15min":1.089},"min":{"1min":0.72899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.276,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.04,"15min":1.042},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0249999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0429999999999999,"15min":1.085},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2130000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0840000000000001,"15min":1.133},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.282,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.77900000000000003}]},{"osd":7,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.399,"5min":1.663,"15min":1.663},"last":1.175},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.095,"15min":1.137},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3839999999999999,"5min":2.02,"15min":2.02},"last":1.202}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.55600000000000005,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.88100000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.51600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.98299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.0489999999999999}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.71399999999999997,"15min":0.80800000000000005},"min":{"1min":0.47099999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.877,"15min":0.97799999999999998},"min":{"1min":0.48799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.282,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.59499999999999997}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.93899999999999995},"min":{"1min":0.70399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.073,"5min":1.3,"15min":1.3},"last":1.0760000000000001}]},{"osd":5,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.66500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.173,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.95899999999999996},"min":{"1min":0.75700000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0009999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.996},"min":{"1min":0.72799999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.125,"15min":1.298},"min":{"1min":0.63,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.181,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":0.86899999999999999}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.69199999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.143,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.006,"15min":1.04},"min":{"1min":0.75700000000000001,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.177,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:00:52.302 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.302 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.302 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.302 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.303 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.304 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.305 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.306 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.306 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.306 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.306 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.306 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.306 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.307 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.308 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.308 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.308 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.308 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.308 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.308 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-08T20:56:40.380872+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=40, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:00:52.309 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:01:11.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:11.369 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:12.310 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:01:12.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 Processor -- start 2024-05-08T21:01:12.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 -- start start 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc6806d0f0 0x7fcc6806a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fcc6815a800 0x7fcc680b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc68159c20 con 0x7fcc68159840 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6815d6c0 con 0x7fcc6815a800 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6f133700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6815d9a0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.427+0000 7fcc6cecf700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fcc68159840 0x7fcc6806c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:40660/0 (socket says 172.21.15.107:40660) 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6cecf700 1 -- 172.21.15.107:0/3154296966 learned_addr learned my addr 172.21.15.107:0/3154296966 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:12.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6d6d0700 1 --2- 172.21.15.107:0/3154296966 >> v2:172.21.15.195:3300/0 conn(0x7fcc6815a800 0x7fcc680b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc67fff700 1 --2- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc6806d0f0 0x7fcc6806a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc677fe700 1 -- 172.21.15.107:0/3154296966 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895444163 0 0) 0x7fcc68159c20 con 0x7fcc68159840 2024-05-08T21:01:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc677fe700 1 -- 172.21.15.107:0/3154296966 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc540035d0 con 0x7fcc68159840 2024-05-08T21:01:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6d6d0700 1 -- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc6806d0f0 msgr2=0x7fcc6806a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6d6d0700 1 --2- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc6806d0f0 0x7fcc6806a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6d6d0700 1 -- 172.21.15.107:0/3154296966 >> v1:172.21.15.107:6789/0 conn(0x7fcc68159840 legacy=0x7fcc6806c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:12.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6d6d0700 1 -- 172.21.15.107:0/3154296966 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6815dc80 con 0x7fcc6815a800 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6d6d0700 1 --2- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc680b3ef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009d90 tx=0x7fcc6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127de052c22da59d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc677fe700 1 -- 172.21.15.107:0/3154296966 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000e070 con 0x7fcc6815a800 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc677fe700 1 -- 172.21.15.107:0/3154296966 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6000bb20 con 0x7fcc6815a800 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc677fe700 1 -- 172.21.15.107:0/3154296966 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc60012430 con 0x7fcc6815a800 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 -- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 msgr2=0x7fcc680b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 --2- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc680b3ef0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009d90 tx=0x7fcc6000b330 comp rx=0 tx=0).stop 2024-05-08T21:01:12.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 -- 172.21.15.107:0/3154296966 shutdown_connections 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 --2- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc680b3ef0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 --2- 172.21.15.107:0/3154296966 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc6806d0f0 0x7fcc6806a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 -- 172.21.15.107:0/3154296966 >> 172.21.15.107:0/3154296966 conn(0x7fcc680cf650 msgr2=0x7fcc680cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 -- 172.21.15.107:0/3154296966 shutdown_connections 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.431+0000 7fcc6f133700 1 -- 172.21.15.107:0/3154296966 wait complete. 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 Processor -- start 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 -- start start 2024-05-08T21:01:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 0x7fcc6815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc68159840 0x7fcc6813e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc681550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680af640 con 0x7fcc6806d0f0 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6815d180 con 0x7fcc6815a800 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6813e580 con 0x7fcc68159840 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 0x7fcc6815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:12.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 0x7fcc6815cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59674/0 (socket says 172.21.15.107:59674) 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 -- 172.21.15.107:0/1769604713 learned_addr learned my addr 172.21.15.107:0/1769604713 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6d6d0700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc681550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc67fff700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc68159840 0x7fcc6813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 -- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc68159840 msgr2=0x7fcc6813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc68159840 0x7fcc6813e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 -- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 msgr2=0x7fcc681550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:12.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc681550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 -- 172.21.15.107:0/1769604713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc60009a70 con 0x7fcc6806d0f0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6cecf700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 0x7fcc6815cc40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c700 tx=0x7fcc5800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58005d90 con 0x7fcc6806d0f0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc580070d0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc680affe0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58007480 con 0x7fcc6806d0f0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.435+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc680b05a0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.439+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc680672a0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.439+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc580075e0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.439+0000 7fcc657fa700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fcc48066730 0x7fcc48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:12.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.439+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fcc580836f0 con 0x7fcc6806d0f0 2024-05-08T21:01:12.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.439+0000 7fcc67fff700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fcc48066730 0x7fcc48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:12.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.439+0000 7fcc67fff700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fcc48066730 0x7fcc48068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc68156630 tx=0x7fcc50009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:12.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.447+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fcc58050900 con 0x7fcc6806d0f0 2024-05-08T21:01:12.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.619+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc6815e240 con 0x7fcc48066730 2024-05-08T21:01:12.640 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.635+0000 7fcc657fa700 1 -- 172.21.15.107:0/1769604713 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289394 (secure 0 0 0) 0x7fcc50011810 con 0x7fcc48066730 2024-05-08T21:01:12.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fcc48066730 msgr2=0x7fcc48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fcc48066730 0x7fcc48068bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc68156630 tx=0x7fcc50009240 comp rx=0 tx=0).stop 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 msgr2=0x7fcc6815cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 0x7fcc6815cc40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800c700 tx=0x7fcc5800ca10 comp rx=0 tx=0).stop 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 shutdown_connections 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc6815a800 0x7fcc681550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fcc48066730 0x7fcc48068bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fcc68159840 0x7fcc6813e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 --2- 172.21.15.107:0/1769604713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc6806d0f0 0x7fcc6815cc40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 >> 172.21.15.107:0/1769604713 conn(0x7fcc680cf650 msgr2=0x7fcc6806d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 shutdown_connections 2024-05-08T21:01:12.648 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:12.639+0000 7fcc6f133700 1 -- 172.21.15.107:0/1769604713 wait complete. 2024-05-08T21:01:12.649 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:01:12.661 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-05-08T21:01:10.790042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681242,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3273,"num_write_kb":33978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7277,"ondisk_log_size":7277,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004421"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:31.585644+0000","last_change":"2024-05-08T20:56:41.798187+0000","last_active":"2024-05-08T21:00:31.585644+0000","last_peered":"2024-05-08T21:00:31.585644+0000","last_clean":"2024-05-08T21:00:31.585644+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:00:31.585644+0000","last_undegraded":"2024-05-08T21:00:31.585644+0000","last_fullsized":"2024-05-08T21:00:31.585644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.615112+0000","last_change":"2024-05-08T21:00:54.615505+0000","last_active":"2024-05-08T21:00:54.615112+0000","last_peered":"2024-05-08T21:00:54.615112+0000","last_clean":"2024-05-08T21:00:54.615112+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:54.615112+0000","last_undegraded":"2024-05-08T21:00:54.615112+0000","last_fullsized":"2024-05-08T21:00:54.615112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:54.615017+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:54.615017+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.615017+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:02.733537+0000","scrub_duration":0.0035085160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:00.307478+0000","last_change":"2024-05-08T21:01:00.307787+0000","last_active":"2024-05-08T21:01:00.307478+0000","last_peered":"2024-05-08T21:01:00.307478+0000","last_clean":"2024-05-08T21:01:00.307478+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:01:00.307478+0000","last_undegraded":"2024-05-08T21:01:00.307478+0000","last_fullsized":"2024-05-08T21:01:00.307478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:01:00.307424+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:01:00.307424+0000","last_clean_scrub_stamp":"2024-05-08T21:01:00.307424+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:08.425945+0000","scrub_duration":0.0026575919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:07.486218+0000","last_change":"2024-05-08T21:01:07.486468+0000","last_active":"2024-05-08T21:01:07.486218+0000","last_peered":"2024-05-08T21:01:07.486218+0000","last_clean":"2024-05-08T21:01:07.486218+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:01:07.486218+0000","last_undegraded":"2024-05-08T21:01:07.486218+0000","last_fullsized":"2024-05-08T21:01:07.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'40","last_scrub_stamp":"2024-05-08T21:01:07.486168+0000","last_deep_scrub":"22'40","last_deep_scrub_stamp":"2024-05-08T21:01:07.486168+0000","last_clean_scrub_stamp":"2024-05-08T21:01:07.486168+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:35.884358+0000","scrub_duration":0.0037742560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443960+0000","last_change":"2024-05-08T20:56:41.795733+0000","last_active":"2024-05-08T21:00:02.443960+0000","last_peered":"2024-05-08T21:00:02.443960+0000","last_clean":"2024-05-08T21:00:02.443960+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:00:02.443960+0000","last_undegraded":"2024-05-08T21:00:02.443960+0000","last_fullsized":"2024-05-08T21:00:02.443960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:08.501296+0000","last_change":"2024-05-08T21:01:08.501620+0000","last_active":"2024-05-08T21:01:08.501296+0000","last_peered":"2024-05-08T21:01:08.501296+0000","last_clean":"2024-05-08T21:01:08.501296+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:01:08.501296+0000","last_undegraded":"2024-05-08T21:01:08.501296+0000","last_fullsized":"2024-05-08T21:01:08.501296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:08.501247+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:08.501247+0000","last_clean_scrub_stamp":"2024-05-08T21:01:08.501247+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:44.111278+0000","scrub_duration":0.0034104869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:07.156723+0000","last_change":"2024-05-08T21:01:07.156988+0000","last_active":"2024-05-08T21:01:07.156723+0000","last_peered":"2024-05-08T21:01:07.156723+0000","last_clean":"2024-05-08T21:01:07.156723+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:01:07.156723+0000","last_undegraded":"2024-05-08T21:01:07.156723+0000","last_fullsized":"2024-05-08T21:01:07.156723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:01:07.156674+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:01:07.156674+0000","last_clean_scrub_stamp":"2024-05-08T21:01:07.156674+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:48.380355+0000","scrub_duration":0.0035795990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443496+0000","last_change":"2024-05-08T20:56:41.804809+0000","last_active":"2024-05-08T21:00:02.443496+0000","last_peered":"2024-05-08T21:00:02.443496+0000","last_clean":"2024-05-08T21:00:02.443496+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:00:02.443496+0000","last_undegraded":"2024-05-08T21:00:02.443496+0000","last_fullsized":"2024-05-08T21:00:02.443496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.446949+0000","last_change":"2024-05-08T20:56:41.805089+0000","last_active":"2024-05-08T21:00:02.446949+0000","last_peered":"2024-05-08T21:00:02.446949+0000","last_clean":"2024-05-08T21:00:02.446949+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:00:02.446949+0000","last_undegraded":"2024-05-08T21:00:02.446949+0000","last_fullsized":"2024-05-08T21:00:02.446949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":67,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.441867+0000","last_change":"2024-05-08T20:56:41.806220+0000","last_active":"2024-05-08T21:00:02.441867+0000","last_peered":"2024-05-08T21:00:02.441867+0000","last_clean":"2024-05-08T21:00:02.441867+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:00:02.441867+0000","last_undegraded":"2024-05-08T21:00:02.441867+0000","last_fullsized":"2024-05-08T21:00:02.441867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.527004+0000","last_change":"2024-05-08T21:00:54.527268+0000","last_active":"2024-05-08T21:00:54.527004+0000","last_peered":"2024-05-08T21:00:54.527004+0000","last_clean":"2024-05-08T21:00:54.527004+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:54.527004+0000","last_undegraded":"2024-05-08T21:00:54.527004+0000","last_fullsized":"2024-05-08T21:00:54.527004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:54.526950+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:54.526950+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.526950+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:37.612705+0000","scrub_duration":0.0031091389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:59.679324+0000","last_change":"2024-05-08T21:00:59.679587+0000","last_active":"2024-05-08T21:00:59.679324+0000","last_peered":"2024-05-08T21:00:59.679324+0000","last_clean":"2024-05-08T21:00:59.679324+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:59.679324+0000","last_undegraded":"2024-05-08T21:00:59.679324+0000","last_fullsized":"2024-05-08T21:00:59.679324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:59.679274+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:59.679274+0000","last_clean_scrub_stamp":"2024-05-08T21:00:59.679274+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:39.106409+0000","scrub_duration":0.0032546670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.652178+0000","last_change":"2024-05-08T21:00:52.652427+0000","last_active":"2024-05-08T21:00:52.652178+0000","last_peered":"2024-05-08T21:00:52.652178+0000","last_clean":"2024-05-08T21:00:52.652178+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:52.652178+0000","last_undegraded":"2024-05-08T21:00:52.652178+0000","last_fullsized":"2024-05-08T21:00:52.652178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:00:52.652123+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:00:52.652123+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.652123+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:51.631619+0000","scrub_duration":0.0034679440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:55.272013+0000","last_change":"2024-05-08T21:00:55.272503+0000","last_active":"2024-05-08T21:00:55.272013+0000","last_peered":"2024-05-08T21:00:55.272013+0000","last_clean":"2024-05-08T21:00:55.272013+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:55.272013+0000","last_undegraded":"2024-05-08T21:00:55.272013+0000","last_fullsized":"2024-05-08T21:00:55.272013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-05-08T21:00:55.271894+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-05-08T21:00:55.271894+0000","last_clean_scrub_stamp":"2024-05-08T21:00:55.271894+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:44.230958+0000","scrub_duration":0.003210114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.552576+0000","last_change":"2024-05-08T21:00:58.552826+0000","last_active":"2024-05-08T21:00:58.552576+0000","last_peered":"2024-05-08T21:00:58.552576+0000","last_clean":"2024-05-08T21:00:58.552576+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:58.552576+0000","last_undegraded":"2024-05-08T21:00:58.552576+0000","last_fullsized":"2024-05-08T21:00:58.552576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'53","last_scrub_stamp":"2024-05-08T21:00:58.552524+0000","last_deep_scrub":"22'53","last_deep_scrub_stamp":"2024-05-08T21:00:58.552524+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.552524+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.267640+0000","scrub_duration":0.003437481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:55.800675+0000","last_change":"2024-05-08T21:00:55.801006+0000","last_active":"2024-05-08T21:00:55.800675+0000","last_peered":"2024-05-08T21:00:55.800675+0000","last_clean":"2024-05-08T21:00:55.800675+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:55.800675+0000","last_undegraded":"2024-05-08T21:00:55.800675+0000","last_fullsized":"2024-05-08T21:00:55.800675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:55.800625+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:55.800625+0000","last_clean_scrub_stamp":"2024-05-08T21:00:55.800625+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:18.405211+0000","scrub_duration":0.003368303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.388923+0000","last_change":"2024-05-08T21:00:53.389267+0000","last_active":"2024-05-08T21:00:53.388923+0000","last_peered":"2024-05-08T21:00:53.388923+0000","last_clean":"2024-05-08T21:00:53.388923+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:53.388923+0000","last_undegraded":"2024-05-08T21:00:53.388923+0000","last_fullsized":"2024-05-08T21:00:53.388923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:53.388815+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:53.388815+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.388815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:44.103931+0000","scrub_duration":0.0034609189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.815621+0000","last_change":"2024-05-08T21:00:54.815897+0000","last_active":"2024-05-08T21:00:54.815621+0000","last_peered":"2024-05-08T21:00:54.815621+0000","last_clean":"2024-05-08T21:00:54.815621+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:54.815621+0000","last_undegraded":"2024-05-08T21:00:54.815621+0000","last_fullsized":"2024-05-08T21:00:54.815621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:54.815573+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:54.815573+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.815573+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:34.242708+0000","scrub_duration":0.0043193149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:06.535845+0000","last_change":"2024-05-08T21:01:06.536253+0000","last_active":"2024-05-08T21:01:06.535845+0000","last_peered":"2024-05-08T21:01:06.535845+0000","last_clean":"2024-05-08T21:01:06.535845+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:01:06.535845+0000","last_undegraded":"2024-05-08T21:01:06.535845+0000","last_fullsized":"2024-05-08T21:01:06.535845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:06.535748+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:06.535748+0000","last_clean_scrub_stamp":"2024-05-08T21:01:06.535748+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:24.610978+0000","scrub_duration":0.0033375499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":87,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.421333+0000","last_change":"2024-05-08T21:01:01.421697+0000","last_active":"2024-05-08T21:01:01.421333+0000","last_peered":"2024-05-08T21:01:01.421333+0000","last_clean":"2024-05-08T21:01:01.421333+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:01:01.421333+0000","last_undegraded":"2024-05-08T21:01:01.421333+0000","last_fullsized":"2024-05-08T21:01:01.421333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'62","last_scrub_stamp":"2024-05-08T21:01:01.421216+0000","last_deep_scrub":"22'62","last_deep_scrub_stamp":"2024-05-08T21:01:01.421216+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.421216+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:09.539737+0000","scrub_duration":0.00343881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":88,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:08.209536+0000","last_change":"2024-05-08T21:01:08.209915+0000","last_active":"2024-05-08T21:01:08.209536+0000","last_peered":"2024-05-08T21:01:08.209536+0000","last_clean":"2024-05-08T21:01:08.209536+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:01:08.209536+0000","last_undegraded":"2024-05-08T21:01:08.209536+0000","last_fullsized":"2024-05-08T21:01:08.209536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'63","last_scrub_stamp":"2024-05-08T21:01:08.209418+0000","last_deep_scrub":"22'63","last_deep_scrub_stamp":"2024-05-08T21:01:08.209418+0000","last_clean_scrub_stamp":"2024-05-08T21:01:08.209418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:11.952289+0000","scrub_duration":0.0036166739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.509706+0000","last_change":"2024-05-08T21:01:04.509968+0000","last_active":"2024-05-08T21:01:04.509706+0000","last_peered":"2024-05-08T21:01:04.509706+0000","last_clean":"2024-05-08T21:01:04.509706+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:01:04.509706+0000","last_undegraded":"2024-05-08T21:01:04.509706+0000","last_fullsized":"2024-05-08T21:01:04.509706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:01:04.509631+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:01:04.509631+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.509631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:25.367581+0000","scrub_duration":0.0033214939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.636744+0000","last_change":"2024-05-08T21:00:50.636980+0000","last_active":"2024-05-08T21:00:50.636744+0000","last_peered":"2024-05-08T21:00:50.636744+0000","last_clean":"2024-05-08T21:00:50.636744+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:50.636744+0000","last_undegraded":"2024-05-08T21:00:50.636744+0000","last_fullsized":"2024-05-08T21:00:50.636744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:50.636690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:50.636690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.636690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:33.722445+0000","scrub_duration":0.0034948969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.399039+0000","last_change":"2024-05-08T21:00:41.399039+0000","last_active":"2024-05-08T21:00:41.399039+0000","last_peered":"2024-05-08T21:00:41.399039+0000","last_clean":"2024-05-08T21:00:41.399039+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:41.399039+0000","last_undegraded":"2024-05-08T21:00:41.399039+0000","last_fullsized":"2024-05-08T21:00:41.399039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.398563+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:04.003149+0000","scrub_duration":0.003734036,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.655428+0000","last_change":"2024-05-08T21:00:47.655428+0000","last_active":"2024-05-08T21:00:47.655428+0000","last_peered":"2024-05-08T21:00:47.655428+0000","last_clean":"2024-05-08T21:00:47.655428+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:47.655428+0000","last_undegraded":"2024-05-08T21:00:47.655428+0000","last_fullsized":"2024-05-08T21:00:47.655428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.655055+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:27.532790+0000","scrub_duration":0.0034201549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:06.337390+0000","last_change":"2024-05-08T21:01:06.337701+0000","last_active":"2024-05-08T21:01:06.337390+0000","last_peered":"2024-05-08T21:01:06.337390+0000","last_clean":"2024-05-08T21:01:06.337390+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:01:06.337390+0000","last_undegraded":"2024-05-08T21:01:06.337390+0000","last_fullsized":"2024-05-08T21:01:06.337390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'66","last_scrub_stamp":"2024-05-08T21:01:06.337340+0000","last_deep_scrub":"22'66","last_deep_scrub_stamp":"2024-05-08T21:01:06.337340+0000","last_clean_scrub_stamp":"2024-05-08T21:01:06.337340+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:57.052455+0000","scrub_duration":0.0032423230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.775760+0000","last_change":"2024-05-08T21:00:47.775760+0000","last_active":"2024-05-08T21:00:47.775760+0000","last_peered":"2024-05-08T21:00:47.775760+0000","last_clean":"2024-05-08T21:00:47.775760+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:47.775760+0000","last_undegraded":"2024-05-08T21:00:47.775760+0000","last_fullsized":"2024-05-08T21:00:47.775760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.775408+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:30.861163+0000","scrub_duration":0.0029691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.428265+0000","last_change":"2024-05-08T20:57:23.945199+0000","last_active":"2024-05-08T21:00:02.428265+0000","last_peered":"2024-05-08T21:00:02.428265+0000","last_clean":"2024-05-08T21:00:02.428265+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:00:02.428265+0000","last_undegraded":"2024-05-08T21:00:02.428265+0000","last_fullsized":"2024-05-08T21:00:02.428265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.247759+0000","last_change":"2024-05-08T21:01:04.248040+0000","last_active":"2024-05-08T21:01:04.247759+0000","last_peered":"2024-05-08T21:01:04.247759+0000","last_clean":"2024-05-08T21:01:04.247759+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:01:04.247759+0000","last_undegraded":"2024-05-08T21:01:04.247759+0000","last_fullsized":"2024-05-08T21:01:04.247759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:01:04.247706+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:01:04.247706+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.247706+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:54.962822+0000","scrub_duration":0.0032607209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.587980+0000","last_change":"2024-05-08T21:01:01.588327+0000","last_active":"2024-05-08T21:01:01.587980+0000","last_peered":"2024-05-08T21:01:01.587980+0000","last_clean":"2024-05-08T21:01:01.587980+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:01:01.587980+0000","last_undegraded":"2024-05-08T21:01:01.587980+0000","last_fullsized":"2024-05-08T21:01:01.587980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:01:01.587882+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:01:01.587882+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.587882+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:19.663112+0000","scrub_duration":0.0036441059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":85,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.854869+0000","last_change":"2024-05-08T21:00:53.855107+0000","last_active":"2024-05-08T21:00:53.854869+0000","last_peered":"2024-05-08T21:00:53.854869+0000","last_clean":"2024-05-08T21:00:53.854869+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:53.854869+0000","last_undegraded":"2024-05-08T21:00:53.854869+0000","last_fullsized":"2024-05-08T21:00:53.854869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-05-08T21:00:53.854816+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-05-08T21:00:53.854816+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.854816+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:33.908539+0000","scrub_duration":0.0038818110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.447189+0000","last_change":"2024-05-08T21:00:56.447416+0000","last_active":"2024-05-08T21:00:56.447189+0000","last_peered":"2024-05-08T21:00:56.447189+0000","last_clean":"2024-05-08T21:00:56.447189+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:56.447189+0000","last_undegraded":"2024-05-08T21:00:56.447189+0000","last_fullsized":"2024-05-08T21:00:56.447189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'69","last_scrub_stamp":"2024-05-08T21:00:56.447138+0000","last_deep_scrub":"22'69","last_deep_scrub_stamp":"2024-05-08T21:00:56.447138+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.447138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:45.406202+0000","scrub_duration":0.0035872759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.728537+0000","last_change":"2024-05-08T21:00:58.728898+0000","last_active":"2024-05-08T21:00:58.728537+0000","last_peered":"2024-05-08T21:00:58.728537+0000","last_clean":"2024-05-08T21:00:58.728537+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:58.728537+0000","last_undegraded":"2024-05-08T21:00:58.728537+0000","last_fullsized":"2024-05-08T21:00:58.728537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:58.728487+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:58.728487+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.728487+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:38.782210+0000","scrub_duration":0.0039242030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1518","reported_seq":1544,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:37.726255+0000","last_change":"2024-05-08T21:00:37.726489+0000","last_active":"2024-05-08T21:00:37.726255+0000","last_peered":"2024-05-08T21:00:37.726255+0000","last_clean":"2024-05-08T21:00:37.726255+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T21:00:37.726255+0000","last_undegraded":"2024-05-08T21:00:37.726255+0000","last_fullsized":"2024-05-08T21:00:37.726255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1518","last_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_deep_scrub":"22'1518","last_deep_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_clean_scrub_stamp":"2024-05-08T21:00:37.726200+0000","objects_scrubbed":1,"log_size":1518,"log_dups_size":0,"ondisk_log_size":1518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:02.621040+0000","scrub_duration":0.020388380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.412337+0000","last_change":"2024-05-08T21:00:44.412664+0000","last_active":"2024-05-08T21:00:44.412337+0000","last_peered":"2024-05-08T21:00:44.412337+0000","last_clean":"2024-05-08T21:00:44.412337+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:44.412337+0000","last_undegraded":"2024-05-08T21:00:44.412337+0000","last_fullsized":"2024-05-08T21:00:44.412337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.412281+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:20.132691+0000","scrub_duration":0.0034358980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'33","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.489280+0000","last_change":"2024-05-08T21:00:42.489459+0000","last_active":"2024-05-08T21:00:42.489280+0000","last_peered":"2024-05-08T21:00:42.489280+0000","last_clean":"2024-05-08T21:00:42.489280+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T21:00:42.489280+0000","last_undegraded":"2024-05-08T21:00:42.489280+0000","last_fullsized":"2024-05-08T21:00:42.489280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.489252+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:07.384093+0000","scrub_duration":0.014418689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.675789+0000","last_change":"2024-05-08T21:00:34.676171+0000","last_active":"2024-05-08T21:00:34.675789+0000","last_peered":"2024-05-08T21:00:34.675789+0000","last_clean":"2024-05-08T21:00:34.675789+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T21:00:34.675789+0000","last_undegraded":"2024-05-08T21:00:34.675789+0000","last_fullsized":"2024-05-08T21:00:34.675789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.675671+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:11.978147+0000","scrub_duration":0.0039060010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.580766+0000","last_change":"2024-05-08T21:01:04.581002+0000","last_active":"2024-05-08T21:01:04.580766+0000","last_peered":"2024-05-08T21:01:04.580766+0000","last_clean":"2024-05-08T21:01:04.580766+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:01:04.580766+0000","last_undegraded":"2024-05-08T21:01:04.580766+0000","last_fullsized":"2024-05-08T21:01:04.580766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'65","last_scrub_stamp":"2024-05-08T21:01:04.580713+0000","last_deep_scrub":"22'65","last_deep_scrub_stamp":"2024-05-08T21:01:04.580713+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.580713+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.596280+0000","scrub_duration":0.0036186040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.444170+0000","last_change":"2024-05-08T21:00:33.444544+0000","last_active":"2024-05-08T21:00:33.444170+0000","last_peered":"2024-05-08T21:00:33.444170+0000","last_clean":"2024-05-08T21:00:33.444170+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T21:00:33.444170+0000","last_undegraded":"2024-05-08T21:00:33.444170+0000","last_fullsized":"2024-05-08T21:00:33.444170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.444064+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:58.392198+0000","scrub_duration":0.0033063799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:49.732502+0000","last_change":"2024-05-08T21:00:49.732741+0000","last_active":"2024-05-08T21:00:49.732502+0000","last_peered":"2024-05-08T21:00:49.732502+0000","last_clean":"2024-05-08T21:00:49.732502+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:49.732502+0000","last_undegraded":"2024-05-08T21:00:49.732502+0000","last_fullsized":"2024-05-08T21:00:49.732502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:00:49.732450+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:00:49.732450+0000","last_clean_scrub_stamp":"2024-05-08T21:00:49.732450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:38.691514+0000","scrub_duration":0.003222319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.583018+0000","last_change":"2024-05-08T21:00:50.583307+0000","last_active":"2024-05-08T21:00:50.583018+0000","last_peered":"2024-05-08T21:00:50.583018+0000","last_clean":"2024-05-08T21:00:50.583018+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T21:00:50.583018+0000","last_undegraded":"2024-05-08T21:00:50.583018+0000","last_fullsized":"2024-05-08T21:00:50.583018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2024-05-08T21:00:50.582969+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2024-05-08T21:00:50.582969+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.582969+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:14.784972+0000","scrub_duration":0.0030323250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.292522+0000","last_change":"2024-05-08T21:00:44.292926+0000","last_active":"2024-05-08T21:00:44.292522+0000","last_peered":"2024-05-08T21:00:44.292522+0000","last_clean":"2024-05-08T21:00:44.292522+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:44.292522+0000","last_undegraded":"2024-05-08T21:00:44.292522+0000","last_fullsized":"2024-05-08T21:00:44.292522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'73","last_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_deep_scrub":"22'73","last_deep_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.292418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:33.251483+0000","scrub_duration":0.003408847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.368845+0000","last_change":"2024-05-08T21:00:39.369186+0000","last_active":"2024-05-08T21:00:39.368845+0000","last_peered":"2024-05-08T21:00:39.368845+0000","last_clean":"2024-05-08T21:00:39.368845+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T21:00:39.368845+0000","last_undegraded":"2024-05-08T21:00:39.368845+0000","last_fullsized":"2024-05-08T21:00:39.368845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.368784+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:19.422507+0000","scrub_duration":0.003438361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:51.263295+0000","last_change":"2024-05-08T21:00:51.263575+0000","last_active":"2024-05-08T21:00:51.263295+0000","last_peered":"2024-05-08T21:00:51.263295+0000","last_clean":"2024-05-08T21:00:51.263295+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:51.263295+0000","last_undegraded":"2024-05-08T21:00:51.263295+0000","last_fullsized":"2024-05-08T21:00:51.263295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:51.263228+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:51.263228+0000","last_clean_scrub_stamp":"2024-05-08T21:00:51.263228+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:30.690363+0000","scrub_duration":0.0036641400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.813390+0000","last_change":"2024-05-08T21:00:45.813637+0000","last_active":"2024-05-08T21:00:45.813390+0000","last_peered":"2024-05-08T21:00:45.813390+0000","last_clean":"2024-05-08T21:00:45.813390+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:45.813390+0000","last_undegraded":"2024-05-08T21:00:45.813390+0000","last_fullsized":"2024-05-08T21:00:45.813390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.813341+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:25.240476+0000","scrub_duration":0.0080349970000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.645222+0000","last_change":"2024-05-08T21:00:47.645482+0000","last_active":"2024-05-08T21:00:47.645222+0000","last_peered":"2024-05-08T21:00:47.645222+0000","last_clean":"2024-05-08T21:00:47.645222+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:47.645222+0000","last_undegraded":"2024-05-08T21:00:47.645222+0000","last_fullsized":"2024-05-08T21:00:47.645222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.645171+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:08.126340+0000","scrub_duration":0.003615516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'916","reported_seq":942,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.539135+0000","last_change":"2024-05-08T21:00:43.539407+0000","last_active":"2024-05-08T21:00:43.539135+0000","last_peered":"2024-05-08T21:00:43.539135+0000","last_clean":"2024-05-08T21:00:43.539135+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T21:00:43.539135+0000","last_undegraded":"2024-05-08T21:00:43.539135+0000","last_fullsized":"2024-05-08T21:00:43.539135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'916","last_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_deep_scrub":"22'916","last_deep_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.539080+0000","objects_scrubbed":4,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:19.259490+0000","scrub_duration":0.023469797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442994+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442994+0000","last_peered":"2024-05-08T21:00:02.442994+0000","last_clean":"2024-05-08T21:00:02.442994+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442994+0000","last_undegraded":"2024-05-08T21:00:02.442994+0000","last_fullsized":"2024-05-08T21:00:02.442994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'19","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.416238+0000","last_change":"2024-05-08T21:00:38.416562+0000","last_active":"2024-05-08T21:00:38.416238+0000","last_peered":"2024-05-08T21:00:38.416238+0000","last_clean":"2024-05-08T21:00:38.416238+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T21:00:38.416238+0000","last_undegraded":"2024-05-08T21:00:38.416238+0000","last_fullsized":"2024-05-08T21:00:38.416238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.416185+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:32.961167+0000","scrub_duration":0.0073912780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.411023+0000","last_change":"2024-05-08T21:00:42.411400+0000","last_active":"2024-05-08T21:00:42.411023+0000","last_peered":"2024-05-08T21:00:42.411023+0000","last_clean":"2024-05-08T21:00:42.411023+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:42.411023+0000","last_undegraded":"2024-05-08T21:00:42.411023+0000","last_fullsized":"2024-05-08T21:00:42.411023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.410909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:52.782534+0000","scrub_duration":0.0037112960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.350327+0000","last_change":"2024-05-08T21:00:40.350668+0000","last_active":"2024-05-08T21:00:40.350327+0000","last_peered":"2024-05-08T21:00:40.350327+0000","last_clean":"2024-05-08T21:00:40.350327+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T21:00:40.350327+0000","last_undegraded":"2024-05-08T21:00:40.350327+0000","last_fullsized":"2024-05-08T21:00:40.350327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.350213+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:19.777348+0000","scrub_duration":0.0036910760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":88,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.193299+0000","last_change":"2024-05-08T21:01:04.193646+0000","last_active":"2024-05-08T21:01:04.193299+0000","last_peered":"2024-05-08T21:01:04.193299+0000","last_clean":"2024-05-08T21:01:04.193299+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:01:04.193299+0000","last_undegraded":"2024-05-08T21:01:04.193299+0000","last_fullsized":"2024-05-08T21:01:04.193299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'63","last_scrub_stamp":"2024-05-08T21:01:04.193194+0000","last_deep_scrub":"22'63","last_deep_scrub_stamp":"2024-05-08T21:01:04.193194+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.193194+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:22.268425+0000","scrub_duration":0.003423054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.424531+0000","last_change":"2024-05-08T21:00:40.424776+0000","last_active":"2024-05-08T21:00:40.424531+0000","last_peered":"2024-05-08T21:00:40.424531+0000","last_clean":"2024-05-08T21:00:40.424531+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T21:00:40.424531+0000","last_undegraded":"2024-05-08T21:00:40.424531+0000","last_fullsized":"2024-05-08T21:00:40.424531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'30","last_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_deep_scrub":"22'30","last_deep_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.424482+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:18.189346+0000","scrub_duration":0.003259638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.558377+0000","last_change":"2024-05-08T21:00:53.558765+0000","last_active":"2024-05-08T21:00:53.558377+0000","last_peered":"2024-05-08T21:00:53.558377+0000","last_clean":"2024-05-08T21:00:53.558377+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:53.558377+0000","last_undegraded":"2024-05-08T21:00:53.558377+0000","last_fullsized":"2024-05-08T21:00:53.558377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:53.558327+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:53.558327+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.558327+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:16.162913+0000","scrub_duration":0.0039466500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'36","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.803315+0000","last_change":"2024-05-08T21:00:42.803499+0000","last_active":"2024-05-08T21:00:42.803315+0000","last_peered":"2024-05-08T21:00:42.803315+0000","last_clean":"2024-05-08T21:00:42.803315+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T21:00:42.803315+0000","last_undegraded":"2024-05-08T21:00:42.803315+0000","last_fullsized":"2024-05-08T21:00:42.803315+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.803281+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:03.284450+0000","scrub_duration":0.013360945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:31.918167+0000","last_change":"2024-05-08T21:00:31.918445+0000","last_active":"2024-05-08T21:00:31.918167+0000","last_peered":"2024-05-08T21:00:31.918167+0000","last_clean":"2024-05-08T21:00:31.918167+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:31.918167+0000","last_undegraded":"2024-05-08T21:00:31.918167+0000","last_fullsized":"2024-05-08T21:00:31.918167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_clean_scrub_stamp":"2024-05-08T21:00:31.918115+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:56.866249+0000","scrub_duration":0.0031224640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.691240+0000","last_change":"2024-05-08T21:00:46.691488+0000","last_active":"2024-05-08T21:00:46.691240+0000","last_peered":"2024-05-08T21:00:46.691240+0000","last_clean":"2024-05-08T21:00:46.691240+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T21:00:46.691240+0000","last_undegraded":"2024-05-08T21:00:46.691240+0000","last_fullsized":"2024-05-08T21:00:46.691240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.691190+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:41.236171+0000","scrub_duration":0.007003202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":64,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:59.232589+0000","last_change":"2024-05-08T21:00:59.232859+0000","last_active":"2024-05-08T21:00:59.232589+0000","last_peered":"2024-05-08T21:00:59.232589+0000","last_clean":"2024-05-08T21:00:59.232589+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:59.232589+0000","last_undegraded":"2024-05-08T21:00:59.232589+0000","last_fullsized":"2024-05-08T21:00:59.232589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2024-05-08T21:00:59.232536+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2024-05-08T21:00:59.232536+0000","last_clean_scrub_stamp":"2024-05-08T21:00:59.232536+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:04.248104+0000","scrub_duration":0.0030277139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'21","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.853958+0000","last_change":"2024-05-08T21:00:47.854245+0000","last_active":"2024-05-08T21:00:47.853958+0000","last_peered":"2024-05-08T21:00:47.853958+0000","last_clean":"2024-05-08T21:00:47.853958+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T21:00:47.853958+0000","last_undegraded":"2024-05-08T21:00:47.853958+0000","last_fullsized":"2024-05-08T21:00:47.853958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.853909+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.574319+0000","scrub_duration":0.0059207569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":61,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.445486+0000","last_change":"2024-05-08T20:56:41.807350+0000","last_active":"2024-05-08T21:00:02.445486+0000","last_peered":"2024-05-08T21:00:02.445486+0000","last_clean":"2024-05-08T21:00:02.445486+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:00:02.445486+0000","last_undegraded":"2024-05-08T21:00:02.445486+0000","last_fullsized":"2024-05-08T21:00:02.445486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'25","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.771047+0000","last_change":"2024-05-08T21:00:33.771270+0000","last_active":"2024-05-08T21:00:33.771047+0000","last_peered":"2024-05-08T21:00:33.771047+0000","last_clean":"2024-05-08T21:00:33.771047+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T21:00:33.771047+0000","last_undegraded":"2024-05-08T21:00:33.771047+0000","last_fullsized":"2024-05-08T21:00:33.771047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.771004+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.252173+0000","scrub_duration":0.006918853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:49.394010+0000","last_change":"2024-05-08T21:00:49.394251+0000","last_active":"2024-05-08T21:00:49.394010+0000","last_peered":"2024-05-08T21:00:49.394010+0000","last_clean":"2024-05-08T21:00:49.394010+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:49.394010+0000","last_undegraded":"2024-05-08T21:00:49.394010+0000","last_fullsized":"2024-05-08T21:00:49.394010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:49.393950+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:49.393950+0000","last_clean_scrub_stamp":"2024-05-08T21:00:49.393950+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:57.512471+0000","scrub_duration":0.0037924870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.796029+0000","last_change":"2024-05-08T21:00:41.796298+0000","last_active":"2024-05-08T21:00:41.796029+0000","last_peered":"2024-05-08T21:00:41.796029+0000","last_clean":"2024-05-08T21:00:41.796029+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T21:00:41.796029+0000","last_undegraded":"2024-05-08T21:00:41.796029+0000","last_fullsized":"2024-05-08T21:00:41.796029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'29","last_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_deep_scrub":"22'29","last_deep_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.795973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:36.340955+0000","scrub_duration":0.003348916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.443048+0000","last_change":"2024-05-08T20:57:23.939637+0000","last_active":"2024-05-08T21:00:02.443048+0000","last_peered":"2024-05-08T21:00:02.443048+0000","last_clean":"2024-05-08T21:00:02.443048+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:00:02.443048+0000","last_undegraded":"2024-05-08T21:00:02.443048+0000","last_fullsized":"2024-05-08T21:00:02.443048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.002791+0000","last_change":"2024-05-08T21:00:40.003115+0000","last_active":"2024-05-08T21:00:40.002791+0000","last_peered":"2024-05-08T21:00:40.002791+0000","last_clean":"2024-05-08T21:00:40.002791+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T21:00:40.002791+0000","last_undegraded":"2024-05-08T21:00:40.002791+0000","last_fullsized":"2024-05-08T21:00:40.002791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.002743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:04.204746+0000","scrub_duration":0.010423897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.434755+0000","last_change":"2024-05-08T21:00:34.434755+0000","last_active":"2024-05-08T21:00:34.434755+0000","last_peered":"2024-05-08T21:00:34.434755+0000","last_clean":"2024-05-08T21:00:34.434755+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T21:00:34.434755+0000","last_undegraded":"2024-05-08T21:00:34.434755+0000","last_fullsized":"2024-05-08T21:00:34.434755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.434434+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:09.727644+0000","scrub_duration":0.0038574659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.754455+0000","last_change":"2024-05-08T21:00:56.754702+0000","last_active":"2024-05-08T21:00:56.754455+0000","last_peered":"2024-05-08T21:00:56.754455+0000","last_clean":"2024-05-08T21:00:56.754455+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:56.754455+0000","last_undegraded":"2024-05-08T21:00:56.754455+0000","last_fullsized":"2024-05-08T21:00:56.754455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2024-05-08T21:00:56.754402+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2024-05-08T21:00:56.754402+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.754402+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:39.840158+0000","scrub_duration":0.0039386769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.042986+0000","last_change":"2024-05-08T21:00:42.042986+0000","last_active":"2024-05-08T21:00:42.042986+0000","last_peered":"2024-05-08T21:00:42.042986+0000","last_clean":"2024-05-08T21:00:42.042986+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T21:00:42.042986+0000","last_undegraded":"2024-05-08T21:00:42.042986+0000","last_fullsized":"2024-05-08T21:00:42.042986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.042532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:21.469667+0000","scrub_duration":0.0045502980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.284423+0000","last_change":"2024-05-08T21:00:52.284423+0000","last_active":"2024-05-08T21:00:52.284423+0000","last_peered":"2024-05-08T21:00:52.284423+0000","last_clean":"2024-05-08T21:00:52.284423+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:52.284423+0000","last_undegraded":"2024-05-08T21:00:52.284423+0000","last_fullsized":"2024-05-08T21:00:52.284423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:52.284118+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:52.284118+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.284118+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:14.888704+0000","scrub_duration":0.0025655999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'74","reported_seq":145,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.858180+0000","last_change":"2024-05-08T21:00:45.858180+0000","last_active":"2024-05-08T21:00:45.858180+0000","last_peered":"2024-05-08T21:00:45.858180+0000","last_clean":"2024-05-08T21:00:45.858180+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:45.858180+0000","last_undegraded":"2024-05-08T21:00:45.858180+0000","last_fullsized":"2024-05-08T21:00:45.858180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'74","last_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_deep_scrub":"22'74","last_deep_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.857839+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:56.229464+0000","scrub_duration":0.0081842159999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:02.540795+0000","last_change":"2024-05-08T21:01:02.541036+0000","last_active":"2024-05-08T21:01:02.540795+0000","last_peered":"2024-05-08T21:01:02.540795+0000","last_clean":"2024-05-08T21:01:02.540795+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:01:02.540795+0000","last_undegraded":"2024-05-08T21:01:02.540795+0000","last_fullsized":"2024-05-08T21:01:02.540795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:01:02.540747+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:01:02.540747+0000","last_clean_scrub_stamp":"2024-05-08T21:01:02.540747+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:06.283618+0000","scrub_duration":0.0034748729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.479144+0000","last_change":"2024-05-08T21:00:32.479144+0000","last_active":"2024-05-08T21:00:32.479144+0000","last_peered":"2024-05-08T21:00:32.479144+0000","last_clean":"2024-05-08T21:00:32.479144+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T21:00:32.479144+0000","last_undegraded":"2024-05-08T21:00:32.479144+0000","last_fullsized":"2024-05-08T21:00:32.479144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.478860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:42.850485+0000","scrub_duration":0.0033808480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.699970+0000","last_change":"2024-05-08T21:00:50.699970+0000","last_active":"2024-05-08T21:00:50.699970+0000","last_peered":"2024-05-08T21:00:50.699970+0000","last_clean":"2024-05-08T21:00:50.699970+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:50.699970+0000","last_undegraded":"2024-05-08T21:00:50.699970+0000","last_fullsized":"2024-05-08T21:00:50.699970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:50.699594+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:50.699594+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.699594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.071219+0000","scrub_duration":0.0030293310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:36.678387+0000","last_change":"2024-05-08T21:00:36.678387+0000","last_active":"2024-05-08T21:00:36.678387+0000","last_peered":"2024-05-08T21:00:36.678387+0000","last_clean":"2024-05-08T21:00:36.678387+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T21:00:36.678387+0000","last_undegraded":"2024-05-08T21:00:36.678387+0000","last_fullsized":"2024-05-08T21:00:36.678387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'22","last_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_deep_scrub":"22'22","last_deep_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_clean_scrub_stamp":"2024-05-08T21:00:36.678044+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:47.049669+0000","scrub_duration":0.0036330770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.353197+0000","last_change":"2024-05-08T21:00:42.353197+0000","last_active":"2024-05-08T21:00:42.353197+0000","last_peered":"2024-05-08T21:00:42.353197+0000","last_clean":"2024-05-08T21:00:42.353197+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:42.353197+0000","last_undegraded":"2024-05-08T21:00:42.353197+0000","last_fullsized":"2024-05-08T21:00:42.353197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.352656+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:25.438411+0000","scrub_duration":0.003835003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.093337+0000","last_change":"2024-05-08T21:00:44.093337+0000","last_active":"2024-05-08T21:00:44.093337+0000","last_peered":"2024-05-08T21:00:44.093337+0000","last_clean":"2024-05-08T21:00:44.093337+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T21:00:44.093337+0000","last_undegraded":"2024-05-08T21:00:44.093337+0000","last_fullsized":"2024-05-08T21:00:44.093337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.092882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:27.178637+0000","scrub_duration":0.0040887049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.788249+0000","last_change":"2024-05-08T21:00:46.788249+0000","last_active":"2024-05-08T21:00:46.788249+0000","last_peered":"2024-05-08T21:00:46.788249+0000","last_clean":"2024-05-08T21:00:46.788249+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:46.788249+0000","last_undegraded":"2024-05-08T21:00:46.788249+0000","last_fullsized":"2024-05-08T21:00:46.788249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.787793+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:09.392379+0000","scrub_duration":0.0034348349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'41","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.788225+0000","last_change":"2024-05-08T21:00:44.788225+0000","last_active":"2024-05-08T21:00:44.788225+0000","last_peered":"2024-05-08T21:00:44.788225+0000","last_clean":"2024-05-08T21:00:44.788225+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:44.788225+0000","last_undegraded":"2024-05-08T21:00:44.788225+0000","last_fullsized":"2024-05-08T21:00:44.788225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.787841+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:24.841564+0000","scrub_duration":0.0082866180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.683673+0000","last_change":"2024-05-08T21:00:39.683673+0000","last_active":"2024-05-08T21:00:39.683673+0000","last_peered":"2024-05-08T21:00:39.683673+0000","last_clean":"2024-05-08T21:00:39.683673+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:39.683673+0000","last_undegraded":"2024-05-08T21:00:39.683673+0000","last_fullsized":"2024-05-08T21:00:39.683673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.683380+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:14.976590+0000","scrub_duration":0.003306767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'27","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.384556+0000","last_change":"2024-05-08T21:00:39.384556+0000","last_active":"2024-05-08T21:00:39.384556+0000","last_peered":"2024-05-08T21:00:39.384556+0000","last_clean":"2024-05-08T21:00:39.384556+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:39.384556+0000","last_undegraded":"2024-05-08T21:00:39.384556+0000","last_fullsized":"2024-05-08T21:00:39.384556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'27","last_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_deep_scrub":"22'27","last_deep_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.384259+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:16.686736+0000","scrub_duration":0.0058410570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.293555+0000","last_change":"2024-05-08T21:00:50.293555+0000","last_active":"2024-05-08T21:00:50.293555+0000","last_peered":"2024-05-08T21:00:50.293555+0000","last_clean":"2024-05-08T21:00:50.293555+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:50.293555+0000","last_undegraded":"2024-05-08T21:00:50.293555+0000","last_fullsized":"2024-05-08T21:00:50.293555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:50.293260+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:50.293260+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.293260+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:30.346983+0000","scrub_duration":0.0036686290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:51.139818+0000","last_change":"2024-05-08T21:00:51.139818+0000","last_active":"2024-05-08T21:00:51.139818+0000","last_peered":"2024-05-08T21:00:51.139818+0000","last_clean":"2024-05-08T21:00:51.139818+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T21:00:51.139818+0000","last_undegraded":"2024-05-08T21:00:51.139818+0000","last_fullsized":"2024-05-08T21:00:51.139818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:51.139546+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:51.139546+0000","last_clean_scrub_stamp":"2024-05-08T21:00:51.139546+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:59.258067+0000","scrub_duration":0.0035273180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.704505+0000","last_change":"2024-05-08T21:00:52.704505+0000","last_active":"2024-05-08T21:00:52.704505+0000","last_peered":"2024-05-08T21:00:52.704505+0000","last_clean":"2024-05-08T21:00:52.704505+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:52.704505+0000","last_undegraded":"2024-05-08T21:00:52.704505+0000","last_fullsized":"2024-05-08T21:00:52.704505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:00:52.704080+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:00:52.704080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.704080+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:28.424490+0000","scrub_duration":0.003400602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.719141+0000","last_change":"2024-05-08T21:00:32.719141+0000","last_active":"2024-05-08T21:00:32.719141+0000","last_peered":"2024-05-08T21:00:32.719141+0000","last_clean":"2024-05-08T21:00:32.719141+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T21:00:32.719141+0000","last_undegraded":"2024-05-08T21:00:32.719141+0000","last_fullsized":"2024-05-08T21:00:32.719141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.718866+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:27.263848+0000","scrub_duration":0.0035823880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.605987+0000","last_change":"2024-05-08T21:01:01.605987+0000","last_active":"2024-05-08T21:01:01.605987+0000","last_peered":"2024-05-08T21:01:01.605987+0000","last_clean":"2024-05-08T21:01:01.605987+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:01:01.605987+0000","last_undegraded":"2024-05-08T21:01:01.605987+0000","last_fullsized":"2024-05-08T21:01:01.605987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:01:01.605708+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:01:01.605708+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.605708+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:52.320824+0000","scrub_duration":0.003097392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.673744+0000","last_change":"2024-05-08T21:00:38.673744+0000","last_active":"2024-05-08T21:00:38.673744+0000","last_peered":"2024-05-08T21:00:38.673744+0000","last_clean":"2024-05-08T21:00:38.673744+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T21:00:38.673744+0000","last_undegraded":"2024-05-08T21:00:38.673744+0000","last_fullsized":"2024-05-08T21:00:38.673744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'31","last_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_deep_scrub":"22'31","last_deep_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.673453+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:14.393863+0000","scrub_duration":0.0031815139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.654744+0000","last_change":"2024-05-08T21:00:45.654995+0000","last_active":"2024-05-08T21:00:45.654744+0000","last_peered":"2024-05-08T21:00:45.654744+0000","last_clean":"2024-05-08T21:00:45.654744+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:45.654744+0000","last_undegraded":"2024-05-08T21:00:45.654744+0000","last_fullsized":"2024-05-08T21:00:45.654744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.654690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:09.856693+0000","scrub_duration":0.0034274710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'520","reported_seq":546,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.091128+0000","last_change":"2024-05-08T21:00:43.091282+0000","last_active":"2024-05-08T21:00:43.091128+0000","last_peered":"2024-05-08T21:00:43.091128+0000","last_clean":"2024-05-08T21:00:43.091128+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T21:00:43.091128+0000","last_undegraded":"2024-05-08T21:00:43.091128+0000","last_fullsized":"2024-05-08T21:00:43.091128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'520","last_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_deep_scrub":"22'520","last_deep_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.091097+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:05.695683+0000","scrub_duration":0.019677249000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.583671+0000","last_change":"2024-05-08T21:00:52.583671+0000","last_active":"2024-05-08T21:00:52.583671+0000","last_peered":"2024-05-08T21:00:52.583671+0000","last_clean":"2024-05-08T21:00:52.583671+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:52.583671+0000","last_undegraded":"2024-05-08T21:00:52.583671+0000","last_fullsized":"2024-05-08T21:00:52.583671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:52.583366+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:52.583366+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.583366+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:32.010501+0000","scrub_duration":0.0031708209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.479826+0000","last_change":"2024-05-08T21:00:56.480126+0000","last_active":"2024-05-08T21:00:56.479826+0000","last_peered":"2024-05-08T21:00:56.479826+0000","last_clean":"2024-05-08T21:00:56.479826+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:56.479826+0000","last_undegraded":"2024-05-08T21:00:56.479826+0000","last_fullsized":"2024-05-08T21:00:56.479826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:56.479773+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:56.479773+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.479773+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.495341+0000","scrub_duration":0.0032261310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'17","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.090009+0000","last_change":"2024-05-08T21:00:46.090256+0000","last_active":"2024-05-08T21:00:46.090009+0000","last_peered":"2024-05-08T21:00:46.090009+0000","last_clean":"2024-05-08T21:00:46.090009+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T21:00:46.090009+0000","last_undegraded":"2024-05-08T21:00:46.090009+0000","last_fullsized":"2024-05-08T21:00:46.090009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'17","last_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_deep_scrub":"22'17","last_deep_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.089958+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:35.049023+0000","scrub_duration":0.0058691460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.756790+0000","last_change":"2024-05-08T21:00:58.757107+0000","last_active":"2024-05-08T21:00:58.756790+0000","last_peered":"2024-05-08T21:00:58.756790+0000","last_clean":"2024-05-08T21:00:58.756790+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:58.756790+0000","last_undegraded":"2024-05-08T21:00:58.756790+0000","last_fullsized":"2024-05-08T21:00:58.756790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:58.756740+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:58.756740+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.756740+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:47.715805+0000","scrub_duration":0.0033771059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.228745+0000","last_change":"2024-05-08T21:00:56.228903+0000","last_active":"2024-05-08T21:00:56.228745+0000","last_peered":"2024-05-08T21:00:56.228745+0000","last_clean":"2024-05-08T21:00:56.228745+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:56.228745+0000","last_undegraded":"2024-05-08T21:00:56.228745+0000","last_fullsized":"2024-05-08T21:00:56.228745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:56.228718+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:56.228718+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.228718+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:46.943834+0000","scrub_duration":0.017730162000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.276376+0000","last_change":"2024-05-08T21:00:53.276376+0000","last_active":"2024-05-08T21:00:53.276376+0000","last_peered":"2024-05-08T21:00:53.276376+0000","last_clean":"2024-05-08T21:00:53.276376+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:53.276376+0000","last_undegraded":"2024-05-08T21:00:53.276376+0000","last_fullsized":"2024-05-08T21:00:53.276376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2024-05-08T21:00:53.276033+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2024-05-08T21:00:53.276033+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.276033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.361788+0000","scrub_duration":0.0035727010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'44","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:35.712444+0000","last_change":"2024-05-08T21:00:35.712444+0000","last_active":"2024-05-08T21:00:35.712444+0000","last_peered":"2024-05-08T21:00:35.712444+0000","last_clean":"2024-05-08T21:00:35.712444+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T21:00:35.712444+0000","last_undegraded":"2024-05-08T21:00:35.712444+0000","last_fullsized":"2024-05-08T21:00:35.712444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_clean_scrub_stamp":"2024-05-08T21:00:35.712232+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:13.477096+0000","scrub_duration":0.017292459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:57.578188+0000","last_change":"2024-05-08T21:00:57.578418+0000","last_active":"2024-05-08T21:00:57.578188+0000","last_peered":"2024-05-08T21:00:57.578188+0000","last_clean":"2024-05-08T21:00:57.578188+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:57.578188+0000","last_undegraded":"2024-05-08T21:00:57.578188+0000","last_fullsized":"2024-05-08T21:00:57.578188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:57.578136+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:57.578136+0000","last_clean_scrub_stamp":"2024-05-08T21:00:57.578136+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:05.696657+0000","scrub_duration":0.0035239300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'52","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.425346+0000","last_change":"2024-05-08T21:00:39.425346+0000","last_active":"2024-05-08T21:00:39.425346+0000","last_peered":"2024-05-08T21:00:39.425346+0000","last_clean":"2024-05-08T21:00:39.425346+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T21:00:39.425346+0000","last_undegraded":"2024-05-08T21:00:39.425346+0000","last_fullsized":"2024-05-08T21:00:39.425346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.425092+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:59.906261+0000","scrub_duration":0.020912884999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090874,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3114,"num_write_kb":31562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3851,"ondisk_log_size":3851,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.01,"5min":1.22,"15min":1.22},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.56799999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1659999999999999,"5min":1.254,"15min":1.254},"last":0.72099999999999997}]},{"osd":1,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.68000000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.137,"5min":1.298,"15min":1.298},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92200000000000004,"15min":0.97099999999999997},"min":{"1min":0.51000000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1719999999999999,"5min":1.274,"15min":1.274},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.96799999999999997,"15min":1.032},"min":{"1min":0.58599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.214,"5min":1.399,"15min":1.399},"last":0.89700000000000002}]},{"osd":3,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.87},"min":{"1min":0.62,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1890000000000001,"5min":1.319,"15min":1.319},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.01,"15min":1.085},"min":{"1min":0.69999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.25,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.014}]},{"osd":4,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1890000000000001,"5min":1.425,"15min":1.425},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.02,"15min":1.0649999999999999},"min":{"1min":0.67600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.1220000000000001,"5min":1.397,"15min":1.397},"last":1.0720000000000001}]},{"osd":5,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0329999999999999,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.347,"5min":1.425,"15min":1.425},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.0940000000000001,"15min":1.135},"min":{"1min":0.77400000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.734,"15min":1.734},"last":1.1599999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.171},"min":{"1min":0.81899999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.286,"5min":1.821,"15min":1.821},"last":1.248},{"interface":"front","average":{"1min":1.095,"5min":1.149,"15min":1.1930000000000001},"min":{"1min":0.83399999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.2609999999999999,"5min":1.45,"15min":1.45},"last":1.1279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14039081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.92200000000000004},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.84799999999999998,"15min":0.91400000000000003},"min":{"1min":0.58599999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.044,"5min":1.343,"15min":1.343},"last":0.60399999999999998}]},{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91200000000000003,"15min":0.98299999999999998},"min":{"1min":0.60299999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":1.02},"min":{"1min":0.68400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2190000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.76800000000000002}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0609999999999999,"5min":1.163,"15min":1.163},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89400000000000002,"15min":0.92000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.155,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92800000000000005}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.96199999999999997},"min":{"1min":0.68300000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.258,"15min":1.258},"last":0.89600000000000002}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.88800000000000001,"15min":0.90000000000000002},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2609999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3069999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.028}]},{"osd":5,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.117,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":1.0860000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3360000000000001,"5min":1.403,"15min":1.403},"last":1.0089999999999999}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1100000000000001,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.377,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.871},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.083,"15min":1.111},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2310000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.048}]}]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.85199999999999998},"min":{"1min":0.443,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":1.173,"15min":1.173},"last":1.008},{"interface":"front","average":{"1min":0.873,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.57699999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.137,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.629}]},{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.86099999999999999,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.85599999999999998},"min":{"1min":0.60499999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":1.256},"last":1.204}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.879,"15min":0.89500000000000002},"min":{"1min":0.61899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.163,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88400000000000001,"15min":0.92500000000000004},"min":{"1min":0.66800000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.109,"5min":1.401,"15min":1.401},"last":0.85499999999999998}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.65000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0900000000000001,"5min":1.256,"15min":1.256},"last":1.048},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.81799999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1830000000000001,"5min":1.341,"15min":1.341},"last":1.1419999999999999}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.93999999999999995,"15min":0.95899999999999996},"min":{"1min":0.59399999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.175,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.622,"5min":0.505,"15min":0.505},"max":{"1min":1.153,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.167}]},{"osd":6,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0369999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.256,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.054,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.105}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.071,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4119999999999999,"5min":1.423,"15min":1.423},"last":0.875},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.139,"15min":1.175},"min":{"1min":0.71999999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3480000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.4750000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81200000000000006,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2609999999999999,"5min":1.466,"15min":1.466},"last":0.86399999999999999}]},{"osd":1,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.51900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0609999999999999,"5min":1.292,"15min":1.292},"last":1.024},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90000000000000002,"15min":0.94199999999999995},"min":{"1min":0.57799999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3700000000000001,"5min":1.556,"15min":1.556},"last":1.1060000000000001}]},{"osd":2,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.745},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85799999999999998,"15min":0.89000000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.123,"5min":1.264,"15min":1.264},"last":0.90400000000000003}]},{"osd":3,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.91200000000000003,"15min":0.94199999999999995},"min":{"1min":0.746,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3220000000000001,"5min":1.613,"15min":1.613},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2250000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.997}]},{"osd":5,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.194,"5min":1.0820000000000001,"15min":1.0960000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":1.0429999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.0449999999999999},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.347,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.036,"5min":0.999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.375,"5min":1.784,"15min":1.784},"last":0.80900000000000005}]},{"osd":7,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0669999999999999,"15min":1.087},"min":{"1min":0.63300000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5529999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.1100000000000001,"15min":1.149},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.419,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.93899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71199999999999997,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":1.109,"15min":1.109},"last":0.69899999999999995}]},{"osd":1,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.72599999999999998},"min":{"1min":0.442,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.47299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89400000000000002,"5min":1.075,"15min":1.075},"last":0.89200000000000002}]},{"osd":2,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.98499999999999999,"5min":1.671,"15min":1.671},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.57399999999999995,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.302,"15min":1.302},"last":0.746}]},{"osd":4,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98499999999999999,"15min":1.014},"min":{"1min":0.78300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3200000000000001,"5min":1.522,"15min":1.522},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0369999999999999,"15min":1.052},"min":{"1min":0.65800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.4139999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.0720000000000001}]},{"osd":5,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3859999999999999,"5min":1.994,"15min":1.994},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.048,"15min":1.0940000000000001},"min":{"1min":0.76600000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2649999999999999,"5min":2.198,"15min":2.198},"last":0.83799999999999997}]},{"osd":6,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.069,"15min":1.099},"min":{"1min":0.72299999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.145,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.085,"15min":1.115},"min":{"1min":0.76500000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1759999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.032}]},{"osd":7,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1639999999999999},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1619999999999999},"min":{"1min":0.78800000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.393,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.93300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85099999999999998,"5min":0.996,"15min":0.996},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.244,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.78400000000000003},"min":{"1min":0.47299999999999998,"5min":0.311,"15min":0.311},"max":{"1min":1.274,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.014,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.91500000000000004}]},{"osd":4,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.57999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.2310000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.96599999999999997,"15min":0.996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.194,"5min":1.577,"15min":1.577},"last":1.2330000000000001}]},{"osd":5,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":1.0269999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2470000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.752},{"interface":"front","average":{"1min":1.024,"5min":1.036,"15min":1.0589999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.651,"5min":1.8,"15min":1.8},"last":1.0669999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0029999999999999,"15min":1.0369999999999999},"min":{"1min":0.63700000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.284},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0149999999999999,"15min":1.097},"min":{"1min":0.66100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.155,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.89100000000000001}]},{"osd":7,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0249999999999999,"15min":1.042},"min":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.258,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.1379999999999999},"min":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.622},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.70499999999999996},"min":{"1min":0.42899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.94299999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.66500000000000004}]},{"osd":2,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.47899999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0900000000000001,"5min":1.294,"15min":1.294},"last":0.73299999999999998}]},{"osd":3,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.56799999999999995,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.173,"15min":1.173},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.79500000000000004}]},{"osd":4,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1879999999999999,"5min":1.26,"15min":1.26},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.96199999999999997,"15min":1.0069999999999999},"min":{"1min":0.79400000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.137,"5min":1.901,"15min":1.901},"last":1.0049999999999999}]},{"osd":5,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.024,"15min":1.089},"min":{"1min":0.72899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.276,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.04,"15min":1.042},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0429999999999999,"15min":1.085},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2130000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0840000000000001,"15min":1.133},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.282,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.101}]},{"osd":7,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.399,"5min":1.663,"15min":1.663},"last":1.196},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.095,"15min":1.137},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3839999999999999,"5min":2.02,"15min":2.02},"last":1.071}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.55600000000000005,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.88100000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.51600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.98299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.71399999999999997,"15min":0.80800000000000005},"min":{"1min":0.47099999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.877,"15min":0.97799999999999998},"min":{"1min":0.48799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.282,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.84299999999999997}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.036},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.93899999999999995},"min":{"1min":0.70399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.073,"5min":1.3,"15min":1.3},"last":0.875}]},{"osd":5,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.66500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.173,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.95899999999999996},"min":{"1min":0.75700000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.012}]},{"osd":6,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.996},"min":{"1min":0.72799999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.125,"15min":1.298},"min":{"1min":0.63,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.181,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":0.89300000000000002}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.69199999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.143,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.006,"15min":1.04},"min":{"1min":0.75700000000000001,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.177,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:01:12.668 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.668 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.668 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.668 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.668 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.669 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.669 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.670 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.670 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:12.671 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:01:32.672 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:01:32.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 Processor -- start 2024-05-08T21:01:32.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- start start 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1440ce990 0x7fe14415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1440b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14415eda0 con 0x7fe14415afa0 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14415ea70 con 0x7fe1440ce990 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415ba90 con 0x7fe14415f770 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1440ce990 0x7fe14415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:32.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe1440ce990 0x7fe14415f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56758/0 (socket says 172.21.15.107:56758) 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 -- 172.21.15.107:0/2955143527 learned_addr learned my addr 172.21.15.107:0/2955143527 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe149a94700 1 --2- 172.21.15.107:0/2955143527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1440b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 -- 172.21.15.107:0/2955143527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 msgr2=0x7fe1440b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 --2- 172.21.15.107:0/2955143527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1440b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 -- 172.21.15.107:0/2955143527 >> v1:172.21.15.195:6789/0 conn(0x7fe14415afa0 legacy=0x7fe14415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 -- 172.21.15.107:0/2955143527 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14415bd40 con 0x7fe1440ce990 2024-05-08T21:01:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe148a92700 1 --2- 172.21.15.107:0/2955143527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe14415f230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe140009910 tx=0x7fe140009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9692cd6c25900b36 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe13bfff700 1 -- 172.21.15.107:0/2955143527 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140011830 con 0x7fe1440ce990 2024-05-08T21:01:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe13bfff700 1 -- 172.21.15.107:0/2955143527 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140011990 con 0x7fe1440ce990 2024-05-08T21:01:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe13bfff700 1 -- 172.21.15.107:0/2955143527 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140011d40 con 0x7fe1440ce990 2024-05-08T21:01:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- 172.21.15.107:0/2955143527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 msgr2=0x7fe14415f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 --2- 172.21.15.107:0/2955143527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe14415f230 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe140009910 tx=0x7fe140009c20 comp rx=0 tx=0).stop 2024-05-08T21:01:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- 172.21.15.107:0/2955143527 shutdown_connections 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 --2- 172.21.15.107:0/2955143527 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1440b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 --2- 172.21.15.107:0/2955143527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe14415f230 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- 172.21.15.107:0/2955143527 >> 172.21.15.107:0/2955143527 conn(0x7fe14406c330 msgr2=0x7fe14406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- 172.21.15.107:0/2955143527 shutdown_connections 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.794+0000 7fe14a295700 1 -- 172.21.15.107:0/2955143527 wait complete. 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 Processor -- start 2024-05-08T21:01:32.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 -- start start 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe1441571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe14415afa0 0x7fe144159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1441520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144159320 con 0x7fe1440ce990 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415a6d0 con 0x7fe14415afa0 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14415a110 con 0x7fe14415f770 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe1441571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe1441571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56772/0 (socket says 172.21.15.107:56772) 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 -- 172.21.15.107:0/1221804693 learned_addr learned my addr 172.21.15.107:0/1221804693 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe148a92700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe14415afa0 0x7fe144159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149a94700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1441520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:32.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 -- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 msgr2=0x7fe1441520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1441520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 -- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe14415afa0 msgr2=0x7fe144159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe14415afa0 0x7fe144159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 -- 172.21.15.107:0/1221804693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140009570 con 0x7fe1440ce990 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe149293700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe1441571f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c500 tx=0x7fe13400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340052d0 con 0x7fe1440ce990 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe134005430 con 0x7fe1440ce990 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14415a3f0 con 0x7fe1440ce990 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1340055a0 con 0x7fe1440ce990 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.798+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1440b2420 con 0x7fe1440ce990 2024-05-08T21:01:32.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.802+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1440684b0 con 0x7fe1440ce990 2024-05-08T21:01:32.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.802+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1340038e0 con 0x7fe1440ce990 2024-05-08T21:01:32.809 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.802+0000 7fe139ffb700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe128066730 0x7fe128068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:32.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.802+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fe134083650 con 0x7fe1440ce990 2024-05-08T21:01:32.810 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.802+0000 7fe148a92700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe128066730 0x7fe128068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:32.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.802+0000 7fe148a92700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe128066730 0x7fe128068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe140000c00 tx=0x7fe140008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:32.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.810+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe134050870 con 0x7fe1440ce990 2024-05-08T21:01:32.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.978+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe14415c300 con 0x7fe128066730 2024-05-08T21:01:33.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:32.994+0000 7fe139ffb700 1 -- 172.21.15.107:0/1221804693 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289900 (secure 0 0 0) 0x7fe140011b80 con 0x7fe128066730 2024-05-08T21:01:33.007 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:01:33.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe128066730 msgr2=0x7fe128068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe128066730 0x7fe128068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe140000c00 tx=0x7fe140008030 comp rx=0 tx=0).stop 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 msgr2=0x7fe1441571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe1441571f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe13400c500 tx=0x7fe13400c810 comp rx=0 tx=0).stop 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 shutdown_connections 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe128066730 0x7fe128068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe14415f770 0x7fe1441520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:33.010 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe14415afa0 0x7fe144159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:33.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 --2- 172.21.15.107:0/1221804693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe1440ce990 0x7fe1441571f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:33.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 >> 172.21.15.107:0/1221804693 conn(0x7fe14406c330 msgr2=0x7fe1440aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:33.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 shutdown_connections 2024-05-08T21:01:33.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:33.002+0000 7fe14a295700 1 -- 172.21.15.107:0/1221804693 wait complete. 2024-05-08T21:01:33.011 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:01:33.022 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-05-08T21:01:32.797524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681242,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3273,"num_write_kb":33978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7277,"ondisk_log_size":7277,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003930"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:16.146788+0000","last_change":"2024-05-08T21:01:16.147168+0000","last_active":"2024-05-08T21:01:16.146788+0000","last_peered":"2024-05-08T21:01:16.146788+0000","last_clean":"2024-05-08T21:01:16.146788+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:01:16.146788+0000","last_undegraded":"2024-05-08T21:01:16.146788+0000","last_fullsized":"2024-05-08T21:01:16.146788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:01:16.146730+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:01:16.146730+0000","last_clean_scrub_stamp":"2024-05-08T21:01:16.146730+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:51.249653+0000","scrub_duration":0.003206637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.615112+0000","last_change":"2024-05-08T21:00:54.615505+0000","last_active":"2024-05-08T21:00:54.615112+0000","last_peered":"2024-05-08T21:00:54.615112+0000","last_clean":"2024-05-08T21:00:54.615112+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:54.615112+0000","last_undegraded":"2024-05-08T21:00:54.615112+0000","last_fullsized":"2024-05-08T21:00:54.615112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:54.615017+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:54.615017+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.615017+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:02.733537+0000","scrub_duration":0.0035085160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:00.307478+0000","last_change":"2024-05-08T21:01:00.307787+0000","last_active":"2024-05-08T21:01:00.307478+0000","last_peered":"2024-05-08T21:01:00.307478+0000","last_clean":"2024-05-08T21:01:00.307478+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:01:00.307478+0000","last_undegraded":"2024-05-08T21:01:00.307478+0000","last_fullsized":"2024-05-08T21:01:00.307478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:01:00.307424+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:01:00.307424+0000","last_clean_scrub_stamp":"2024-05-08T21:01:00.307424+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:08.425945+0000","scrub_duration":0.0026575919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:07.486218+0000","last_change":"2024-05-08T21:01:07.486468+0000","last_active":"2024-05-08T21:01:07.486218+0000","last_peered":"2024-05-08T21:01:07.486218+0000","last_clean":"2024-05-08T21:01:07.486218+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:01:07.486218+0000","last_undegraded":"2024-05-08T21:01:07.486218+0000","last_fullsized":"2024-05-08T21:01:07.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'40","last_scrub_stamp":"2024-05-08T21:01:07.486168+0000","last_deep_scrub":"22'40","last_deep_scrub_stamp":"2024-05-08T21:01:07.486168+0000","last_clean_scrub_stamp":"2024-05-08T21:01:07.486168+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:35.884358+0000","scrub_duration":0.0037742560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:17.191698+0000","last_change":"2024-05-08T21:01:17.191936+0000","last_active":"2024-05-08T21:01:17.191698+0000","last_peered":"2024-05-08T21:01:17.191698+0000","last_clean":"2024-05-08T21:01:17.191698+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:01:17.191698+0000","last_undegraded":"2024-05-08T21:01:17.191698+0000","last_fullsized":"2024-05-08T21:01:17.191698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:01:17.191647+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:01:17.191647+0000","last_clean_scrub_stamp":"2024-05-08T21:01:17.191647+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:11.390264+0000","scrub_duration":0.0035349840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:08.501296+0000","last_change":"2024-05-08T21:01:08.501620+0000","last_active":"2024-05-08T21:01:08.501296+0000","last_peered":"2024-05-08T21:01:08.501296+0000","last_clean":"2024-05-08T21:01:08.501296+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:01:08.501296+0000","last_undegraded":"2024-05-08T21:01:08.501296+0000","last_fullsized":"2024-05-08T21:01:08.501296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:08.501247+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:08.501247+0000","last_clean_scrub_stamp":"2024-05-08T21:01:08.501247+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:44.111278+0000","scrub_duration":0.0034104869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:07.156723+0000","last_change":"2024-05-08T21:01:07.156988+0000","last_active":"2024-05-08T21:01:07.156723+0000","last_peered":"2024-05-08T21:01:07.156723+0000","last_clean":"2024-05-08T21:01:07.156723+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:01:07.156723+0000","last_undegraded":"2024-05-08T21:01:07.156723+0000","last_fullsized":"2024-05-08T21:01:07.156723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:01:07.156674+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:01:07.156674+0000","last_clean_scrub_stamp":"2024-05-08T21:01:07.156674+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:48.380355+0000","scrub_duration":0.0035795990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:09.575801+0000","last_change":"2024-05-08T21:01:09.576036+0000","last_active":"2024-05-08T21:01:09.575801+0000","last_peered":"2024-05-08T21:01:09.575801+0000","last_clean":"2024-05-08T21:01:09.575801+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:01:09.575801+0000","last_undegraded":"2024-05-08T21:01:09.575801+0000","last_fullsized":"2024-05-08T21:01:09.575801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:09.575748+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:09.575748+0000","last_clean_scrub_stamp":"2024-05-08T21:01:09.575748+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:27.650979+0000","scrub_duration":0.0033039879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:12.191829+0000","last_change":"2024-05-08T21:01:12.192092+0000","last_active":"2024-05-08T21:01:12.191829+0000","last_peered":"2024-05-08T21:01:12.191829+0000","last_clean":"2024-05-08T21:01:12.191829+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:01:12.191829+0000","last_undegraded":"2024-05-08T21:01:12.191829+0000","last_fullsized":"2024-05-08T21:01:12.191829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:01:12.191775+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:01:12.191775+0000","last_clean_scrub_stamp":"2024-05-08T21:01:12.191775+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:02.877044+0000","scrub_duration":0.0033871589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:09.279962+0000","last_change":"2024-05-08T21:01:09.280263+0000","last_active":"2024-05-08T21:01:09.279962+0000","last_peered":"2024-05-08T21:01:09.279962+0000","last_clean":"2024-05-08T21:01:09.279962+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:01:09.279962+0000","last_undegraded":"2024-05-08T21:01:09.279962+0000","last_fullsized":"2024-05-08T21:01:09.279962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'53","last_scrub_stamp":"2024-05-08T21:01:09.279909+0000","last_deep_scrub":"22'53","last_deep_scrub_stamp":"2024-05-08T21:01:09.279909+0000","last_clean_scrub_stamp":"2024-05-08T21:01:09.279909+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:14.295476+0000","scrub_duration":0.0030867630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.527004+0000","last_change":"2024-05-08T21:00:54.527268+0000","last_active":"2024-05-08T21:00:54.527004+0000","last_peered":"2024-05-08T21:00:54.527004+0000","last_clean":"2024-05-08T21:00:54.527004+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:54.527004+0000","last_undegraded":"2024-05-08T21:00:54.527004+0000","last_fullsized":"2024-05-08T21:00:54.527004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:54.526950+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:54.526950+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.526950+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:37.612705+0000","scrub_duration":0.0031091389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:59.679324+0000","last_change":"2024-05-08T21:00:59.679587+0000","last_active":"2024-05-08T21:00:59.679324+0000","last_peered":"2024-05-08T21:00:59.679324+0000","last_clean":"2024-05-08T21:00:59.679324+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:59.679324+0000","last_undegraded":"2024-05-08T21:00:59.679324+0000","last_fullsized":"2024-05-08T21:00:59.679324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:59.679274+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:59.679274+0000","last_clean_scrub_stamp":"2024-05-08T21:00:59.679274+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:39.106409+0000","scrub_duration":0.0032546670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.652178+0000","last_change":"2024-05-08T21:00:52.652427+0000","last_active":"2024-05-08T21:00:52.652178+0000","last_peered":"2024-05-08T21:00:52.652178+0000","last_clean":"2024-05-08T21:00:52.652178+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:52.652178+0000","last_undegraded":"2024-05-08T21:00:52.652178+0000","last_fullsized":"2024-05-08T21:00:52.652178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:00:52.652123+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:00:52.652123+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.652123+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:51.631619+0000","scrub_duration":0.0034679440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":85,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:55.272503+0000","last_change":"2024-05-08T21:00:55.272503+0000","last_active":"2024-05-08T21:00:55.272503+0000","last_peered":"2024-05-08T21:00:55.272503+0000","last_clean":"2024-05-08T21:00:55.272503+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:55.272503+0000","last_undegraded":"2024-05-08T21:00:55.272503+0000","last_fullsized":"2024-05-08T21:00:55.272503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-05-08T21:00:55.271894+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-05-08T21:00:55.271894+0000","last_clean_scrub_stamp":"2024-05-08T21:00:55.271894+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:44.230958+0000","scrub_duration":0.003210114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.552826+0000","last_change":"2024-05-08T21:00:58.552826+0000","last_active":"2024-05-08T21:00:58.552826+0000","last_peered":"2024-05-08T21:00:58.552826+0000","last_clean":"2024-05-08T21:00:58.552826+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:58.552826+0000","last_undegraded":"2024-05-08T21:00:58.552826+0000","last_fullsized":"2024-05-08T21:00:58.552826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'53","last_scrub_stamp":"2024-05-08T21:00:58.552524+0000","last_deep_scrub":"22'53","last_deep_scrub_stamp":"2024-05-08T21:00:58.552524+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.552524+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.267640+0000","scrub_duration":0.003437481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:55.800675+0000","last_change":"2024-05-08T21:00:55.801006+0000","last_active":"2024-05-08T21:00:55.800675+0000","last_peered":"2024-05-08T21:00:55.800675+0000","last_clean":"2024-05-08T21:00:55.800675+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:55.800675+0000","last_undegraded":"2024-05-08T21:00:55.800675+0000","last_fullsized":"2024-05-08T21:00:55.800675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:55.800625+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:55.800625+0000","last_clean_scrub_stamp":"2024-05-08T21:00:55.800625+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:18.405211+0000","scrub_duration":0.003368303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.389267+0000","last_change":"2024-05-08T21:00:53.389267+0000","last_active":"2024-05-08T21:00:53.389267+0000","last_peered":"2024-05-08T21:00:53.389267+0000","last_clean":"2024-05-08T21:00:53.389267+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:53.389267+0000","last_undegraded":"2024-05-08T21:00:53.389267+0000","last_fullsized":"2024-05-08T21:00:53.389267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:53.388815+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:53.388815+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.388815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:44.103931+0000","scrub_duration":0.0034609189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.815897+0000","last_change":"2024-05-08T21:00:54.815897+0000","last_active":"2024-05-08T21:00:54.815897+0000","last_peered":"2024-05-08T21:00:54.815897+0000","last_clean":"2024-05-08T21:00:54.815897+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:54.815897+0000","last_undegraded":"2024-05-08T21:00:54.815897+0000","last_fullsized":"2024-05-08T21:00:54.815897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:54.815573+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:54.815573+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.815573+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:34.242708+0000","scrub_duration":0.0043193149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:06.535845+0000","last_change":"2024-05-08T21:01:06.536253+0000","last_active":"2024-05-08T21:01:06.535845+0000","last_peered":"2024-05-08T21:01:06.535845+0000","last_clean":"2024-05-08T21:01:06.535845+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:01:06.535845+0000","last_undegraded":"2024-05-08T21:01:06.535845+0000","last_fullsized":"2024-05-08T21:01:06.535845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:06.535748+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:06.535748+0000","last_clean_scrub_stamp":"2024-05-08T21:01:06.535748+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:24.610978+0000","scrub_duration":0.0033375499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":88,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.421697+0000","last_change":"2024-05-08T21:01:01.421697+0000","last_active":"2024-05-08T21:01:01.421697+0000","last_peered":"2024-05-08T21:01:01.421697+0000","last_clean":"2024-05-08T21:01:01.421697+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:01:01.421697+0000","last_undegraded":"2024-05-08T21:01:01.421697+0000","last_fullsized":"2024-05-08T21:01:01.421697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'62","last_scrub_stamp":"2024-05-08T21:01:01.421216+0000","last_deep_scrub":"22'62","last_deep_scrub_stamp":"2024-05-08T21:01:01.421216+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.421216+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:09.539737+0000","scrub_duration":0.00343881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:08.209915+0000","last_change":"2024-05-08T21:01:08.209915+0000","last_active":"2024-05-08T21:01:08.209915+0000","last_peered":"2024-05-08T21:01:08.209915+0000","last_clean":"2024-05-08T21:01:08.209915+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:01:08.209915+0000","last_undegraded":"2024-05-08T21:01:08.209915+0000","last_fullsized":"2024-05-08T21:01:08.209915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'63","last_scrub_stamp":"2024-05-08T21:01:08.209418+0000","last_deep_scrub":"22'63","last_deep_scrub_stamp":"2024-05-08T21:01:08.209418+0000","last_clean_scrub_stamp":"2024-05-08T21:01:08.209418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:11.952289+0000","scrub_duration":0.0036166739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.509968+0000","last_change":"2024-05-08T21:01:04.509968+0000","last_active":"2024-05-08T21:01:04.509968+0000","last_peered":"2024-05-08T21:01:04.509968+0000","last_clean":"2024-05-08T21:01:04.509968+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:01:04.509968+0000","last_undegraded":"2024-05-08T21:01:04.509968+0000","last_fullsized":"2024-05-08T21:01:04.509968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:01:04.509631+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:01:04.509631+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.509631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:25.367581+0000","scrub_duration":0.0033214939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.636980+0000","last_change":"2024-05-08T21:00:50.636980+0000","last_active":"2024-05-08T21:00:50.636980+0000","last_peered":"2024-05-08T21:00:50.636980+0000","last_clean":"2024-05-08T21:00:50.636980+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:50.636980+0000","last_undegraded":"2024-05-08T21:00:50.636980+0000","last_fullsized":"2024-05-08T21:00:50.636980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:50.636690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:50.636690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.636690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:33.722445+0000","scrub_duration":0.0034948969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.399039+0000","last_change":"2024-05-08T21:00:41.399039+0000","last_active":"2024-05-08T21:00:41.399039+0000","last_peered":"2024-05-08T21:00:41.399039+0000","last_clean":"2024-05-08T21:00:41.399039+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:41.399039+0000","last_undegraded":"2024-05-08T21:00:41.399039+0000","last_fullsized":"2024-05-08T21:00:41.399039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.398563+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:04.003149+0000","scrub_duration":0.003734036,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.655428+0000","last_change":"2024-05-08T21:00:47.655428+0000","last_active":"2024-05-08T21:00:47.655428+0000","last_peered":"2024-05-08T21:00:47.655428+0000","last_clean":"2024-05-08T21:00:47.655428+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:47.655428+0000","last_undegraded":"2024-05-08T21:00:47.655428+0000","last_fullsized":"2024-05-08T21:00:47.655428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.655055+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:27.532790+0000","scrub_duration":0.0034201549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:06.337390+0000","last_change":"2024-05-08T21:01:06.337701+0000","last_active":"2024-05-08T21:01:06.337390+0000","last_peered":"2024-05-08T21:01:06.337390+0000","last_clean":"2024-05-08T21:01:06.337390+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:01:06.337390+0000","last_undegraded":"2024-05-08T21:01:06.337390+0000","last_fullsized":"2024-05-08T21:01:06.337390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'66","last_scrub_stamp":"2024-05-08T21:01:06.337340+0000","last_deep_scrub":"22'66","last_deep_scrub_stamp":"2024-05-08T21:01:06.337340+0000","last_clean_scrub_stamp":"2024-05-08T21:01:06.337340+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:57.052455+0000","scrub_duration":0.0032423230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.775760+0000","last_change":"2024-05-08T21:00:47.775760+0000","last_active":"2024-05-08T21:00:47.775760+0000","last_peered":"2024-05-08T21:00:47.775760+0000","last_clean":"2024-05-08T21:00:47.775760+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:47.775760+0000","last_undegraded":"2024-05-08T21:00:47.775760+0000","last_fullsized":"2024-05-08T21:00:47.775760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.775408+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:30.861163+0000","scrub_duration":0.0029691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:09.552403+0000","last_change":"2024-05-08T21:01:09.552675+0000","last_active":"2024-05-08T21:01:09.552403+0000","last_peered":"2024-05-08T21:01:09.552403+0000","last_clean":"2024-05-08T21:01:09.552403+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:01:09.552403+0000","last_undegraded":"2024-05-08T21:01:09.552403+0000","last_fullsized":"2024-05-08T21:01:09.552403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:01:09.552351+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:01:09.552351+0000","last_clean_scrub_stamp":"2024-05-08T21:01:09.552351+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:50.776032+0000","scrub_duration":0.0034649300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.247759+0000","last_change":"2024-05-08T21:01:04.248040+0000","last_active":"2024-05-08T21:01:04.247759+0000","last_peered":"2024-05-08T21:01:04.247759+0000","last_clean":"2024-05-08T21:01:04.247759+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:01:04.247759+0000","last_undegraded":"2024-05-08T21:01:04.247759+0000","last_fullsized":"2024-05-08T21:01:04.247759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:01:04.247706+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:01:04.247706+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.247706+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:54.962822+0000","scrub_duration":0.0032607209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.587980+0000","last_change":"2024-05-08T21:01:01.588327+0000","last_active":"2024-05-08T21:01:01.587980+0000","last_peered":"2024-05-08T21:01:01.587980+0000","last_clean":"2024-05-08T21:01:01.587980+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:01:01.587980+0000","last_undegraded":"2024-05-08T21:01:01.587980+0000","last_fullsized":"2024-05-08T21:01:01.587980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:01:01.587882+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:01:01.587882+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.587882+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:19.663112+0000","scrub_duration":0.0036441059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":85,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.854869+0000","last_change":"2024-05-08T21:00:53.855107+0000","last_active":"2024-05-08T21:00:53.854869+0000","last_peered":"2024-05-08T21:00:53.854869+0000","last_clean":"2024-05-08T21:00:53.854869+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:53.854869+0000","last_undegraded":"2024-05-08T21:00:53.854869+0000","last_fullsized":"2024-05-08T21:00:53.854869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-05-08T21:00:53.854816+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-05-08T21:00:53.854816+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.854816+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:33.908539+0000","scrub_duration":0.0038818110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.447189+0000","last_change":"2024-05-08T21:00:56.447416+0000","last_active":"2024-05-08T21:00:56.447189+0000","last_peered":"2024-05-08T21:00:56.447189+0000","last_clean":"2024-05-08T21:00:56.447189+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:56.447189+0000","last_undegraded":"2024-05-08T21:00:56.447189+0000","last_fullsized":"2024-05-08T21:00:56.447189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'69","last_scrub_stamp":"2024-05-08T21:00:56.447138+0000","last_deep_scrub":"22'69","last_deep_scrub_stamp":"2024-05-08T21:00:56.447138+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.447138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:45.406202+0000","scrub_duration":0.0035872759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.728537+0000","last_change":"2024-05-08T21:00:58.728898+0000","last_active":"2024-05-08T21:00:58.728537+0000","last_peered":"2024-05-08T21:00:58.728537+0000","last_clean":"2024-05-08T21:00:58.728537+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:58.728537+0000","last_undegraded":"2024-05-08T21:00:58.728537+0000","last_fullsized":"2024-05-08T21:00:58.728537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:58.728487+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:58.728487+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.728487+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:38.782210+0000","scrub_duration":0.0039242030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1518","reported_seq":1544,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:37.726255+0000","last_change":"2024-05-08T21:00:37.726489+0000","last_active":"2024-05-08T21:00:37.726255+0000","last_peered":"2024-05-08T21:00:37.726255+0000","last_clean":"2024-05-08T21:00:37.726255+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T21:00:37.726255+0000","last_undegraded":"2024-05-08T21:00:37.726255+0000","last_fullsized":"2024-05-08T21:00:37.726255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1518","last_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_deep_scrub":"22'1518","last_deep_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_clean_scrub_stamp":"2024-05-08T21:00:37.726200+0000","objects_scrubbed":1,"log_size":1518,"log_dups_size":0,"ondisk_log_size":1518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:02.621040+0000","scrub_duration":0.020388380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.412337+0000","last_change":"2024-05-08T21:00:44.412664+0000","last_active":"2024-05-08T21:00:44.412337+0000","last_peered":"2024-05-08T21:00:44.412337+0000","last_clean":"2024-05-08T21:00:44.412337+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:44.412337+0000","last_undegraded":"2024-05-08T21:00:44.412337+0000","last_fullsized":"2024-05-08T21:00:44.412337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.412281+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:20.132691+0000","scrub_duration":0.0034358980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'33","reported_seq":59,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.489280+0000","last_change":"2024-05-08T21:00:42.489459+0000","last_active":"2024-05-08T21:00:42.489280+0000","last_peered":"2024-05-08T21:00:42.489280+0000","last_clean":"2024-05-08T21:00:42.489280+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T21:00:42.489280+0000","last_undegraded":"2024-05-08T21:00:42.489280+0000","last_fullsized":"2024-05-08T21:00:42.489280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.489252+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:07.384093+0000","scrub_duration":0.014418689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":45,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.675789+0000","last_change":"2024-05-08T21:00:34.676171+0000","last_active":"2024-05-08T21:00:34.675789+0000","last_peered":"2024-05-08T21:00:34.675789+0000","last_clean":"2024-05-08T21:00:34.675789+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T21:00:34.675789+0000","last_undegraded":"2024-05-08T21:00:34.675789+0000","last_fullsized":"2024-05-08T21:00:34.675789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.675671+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:11.978147+0000","scrub_duration":0.0039060010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":90,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.580766+0000","last_change":"2024-05-08T21:01:04.581002+0000","last_active":"2024-05-08T21:01:04.580766+0000","last_peered":"2024-05-08T21:01:04.580766+0000","last_clean":"2024-05-08T21:01:04.580766+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:01:04.580766+0000","last_undegraded":"2024-05-08T21:01:04.580766+0000","last_fullsized":"2024-05-08T21:01:04.580766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'65","last_scrub_stamp":"2024-05-08T21:01:04.580713+0000","last_deep_scrub":"22'65","last_deep_scrub_stamp":"2024-05-08T21:01:04.580713+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.580713+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.596280+0000","scrub_duration":0.0036186040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.444170+0000","last_change":"2024-05-08T21:00:33.444544+0000","last_active":"2024-05-08T21:00:33.444170+0000","last_peered":"2024-05-08T21:00:33.444170+0000","last_clean":"2024-05-08T21:00:33.444170+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T21:00:33.444170+0000","last_undegraded":"2024-05-08T21:00:33.444170+0000","last_fullsized":"2024-05-08T21:00:33.444170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.444064+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:58.392198+0000","scrub_duration":0.0033063799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:49.732502+0000","last_change":"2024-05-08T21:00:49.732741+0000","last_active":"2024-05-08T21:00:49.732502+0000","last_peered":"2024-05-08T21:00:49.732502+0000","last_clean":"2024-05-08T21:00:49.732502+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:49.732502+0000","last_undegraded":"2024-05-08T21:00:49.732502+0000","last_fullsized":"2024-05-08T21:00:49.732502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:00:49.732450+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:00:49.732450+0000","last_clean_scrub_stamp":"2024-05-08T21:00:49.732450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:38.691514+0000","scrub_duration":0.003222319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.583018+0000","last_change":"2024-05-08T21:00:50.583307+0000","last_active":"2024-05-08T21:00:50.583018+0000","last_peered":"2024-05-08T21:00:50.583018+0000","last_clean":"2024-05-08T21:00:50.583018+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T21:00:50.583018+0000","last_undegraded":"2024-05-08T21:00:50.583018+0000","last_fullsized":"2024-05-08T21:00:50.583018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2024-05-08T21:00:50.582969+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2024-05-08T21:00:50.582969+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.582969+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:14.784972+0000","scrub_duration":0.0030323250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":98,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.292522+0000","last_change":"2024-05-08T21:00:44.292926+0000","last_active":"2024-05-08T21:00:44.292522+0000","last_peered":"2024-05-08T21:00:44.292522+0000","last_clean":"2024-05-08T21:00:44.292522+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:44.292522+0000","last_undegraded":"2024-05-08T21:00:44.292522+0000","last_fullsized":"2024-05-08T21:00:44.292522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'73","last_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_deep_scrub":"22'73","last_deep_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.292418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:33.251483+0000","scrub_duration":0.003408847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.368845+0000","last_change":"2024-05-08T21:00:39.369186+0000","last_active":"2024-05-08T21:00:39.368845+0000","last_peered":"2024-05-08T21:00:39.368845+0000","last_clean":"2024-05-08T21:00:39.368845+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T21:00:39.368845+0000","last_undegraded":"2024-05-08T21:00:39.368845+0000","last_fullsized":"2024-05-08T21:00:39.368845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.368784+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:19.422507+0000","scrub_duration":0.003438361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:51.263295+0000","last_change":"2024-05-08T21:00:51.263575+0000","last_active":"2024-05-08T21:00:51.263295+0000","last_peered":"2024-05-08T21:00:51.263295+0000","last_clean":"2024-05-08T21:00:51.263295+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:51.263295+0000","last_undegraded":"2024-05-08T21:00:51.263295+0000","last_fullsized":"2024-05-08T21:00:51.263295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:51.263228+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:51.263228+0000","last_clean_scrub_stamp":"2024-05-08T21:00:51.263228+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:30.690363+0000","scrub_duration":0.0036641400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.813390+0000","last_change":"2024-05-08T21:00:45.813637+0000","last_active":"2024-05-08T21:00:45.813390+0000","last_peered":"2024-05-08T21:00:45.813390+0000","last_clean":"2024-05-08T21:00:45.813390+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:45.813390+0000","last_undegraded":"2024-05-08T21:00:45.813390+0000","last_fullsized":"2024-05-08T21:00:45.813390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.813341+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:25.240476+0000","scrub_duration":0.0080349970000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.645482+0000","last_change":"2024-05-08T21:00:47.645482+0000","last_active":"2024-05-08T21:00:47.645482+0000","last_peered":"2024-05-08T21:00:47.645482+0000","last_clean":"2024-05-08T21:00:47.645482+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:47.645482+0000","last_undegraded":"2024-05-08T21:00:47.645482+0000","last_fullsized":"2024-05-08T21:00:47.645482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.645171+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:08.126340+0000","scrub_duration":0.003615516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'916","reported_seq":943,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.539407+0000","last_change":"2024-05-08T21:00:43.539407+0000","last_active":"2024-05-08T21:00:43.539407+0000","last_peered":"2024-05-08T21:00:43.539407+0000","last_clean":"2024-05-08T21:00:43.539407+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T21:00:43.539407+0000","last_undegraded":"2024-05-08T21:00:43.539407+0000","last_fullsized":"2024-05-08T21:00:43.539407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'916","last_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_deep_scrub":"22'916","last_deep_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.539080+0000","objects_scrubbed":4,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:19.259490+0000","scrub_duration":0.023469797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:02.442994+0000","last_change":"2024-05-08T20:56:41.802506+0000","last_active":"2024-05-08T21:00:02.442994+0000","last_peered":"2024-05-08T21:00:02.442994+0000","last_clean":"2024-05-08T21:00:02.442994+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:00:02.442994+0000","last_undegraded":"2024-05-08T21:00:02.442994+0000","last_fullsized":"2024-05-08T21:00:02.442994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:56:41.384468+0000","last_clean_scrub_stamp":"2024-05-08T20:56:41.384468+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'19","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.416562+0000","last_change":"2024-05-08T21:00:38.416562+0000","last_active":"2024-05-08T21:00:38.416562+0000","last_peered":"2024-05-08T21:00:38.416562+0000","last_clean":"2024-05-08T21:00:38.416562+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T21:00:38.416562+0000","last_undegraded":"2024-05-08T21:00:38.416562+0000","last_fullsized":"2024-05-08T21:00:38.416562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.416185+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:32.961167+0000","scrub_duration":0.0073912780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.411400+0000","last_change":"2024-05-08T21:00:42.411400+0000","last_active":"2024-05-08T21:00:42.411400+0000","last_peered":"2024-05-08T21:00:42.411400+0000","last_clean":"2024-05-08T21:00:42.411400+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:42.411400+0000","last_undegraded":"2024-05-08T21:00:42.411400+0000","last_fullsized":"2024-05-08T21:00:42.411400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.410909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:52.782534+0000","scrub_duration":0.0037112960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.350668+0000","last_change":"2024-05-08T21:00:40.350668+0000","last_active":"2024-05-08T21:00:40.350668+0000","last_peered":"2024-05-08T21:00:40.350668+0000","last_clean":"2024-05-08T21:00:40.350668+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T21:00:40.350668+0000","last_undegraded":"2024-05-08T21:00:40.350668+0000","last_fullsized":"2024-05-08T21:00:40.350668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.350213+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:19.777348+0000","scrub_duration":0.0036910760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.193646+0000","last_change":"2024-05-08T21:01:04.193646+0000","last_active":"2024-05-08T21:01:04.193646+0000","last_peered":"2024-05-08T21:01:04.193646+0000","last_clean":"2024-05-08T21:01:04.193646+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:01:04.193646+0000","last_undegraded":"2024-05-08T21:01:04.193646+0000","last_fullsized":"2024-05-08T21:01:04.193646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'63","last_scrub_stamp":"2024-05-08T21:01:04.193194+0000","last_deep_scrub":"22'63","last_deep_scrub_stamp":"2024-05-08T21:01:04.193194+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.193194+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:22.268425+0000","scrub_duration":0.003423054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.424776+0000","last_change":"2024-05-08T21:00:40.424776+0000","last_active":"2024-05-08T21:00:40.424776+0000","last_peered":"2024-05-08T21:00:40.424776+0000","last_clean":"2024-05-08T21:00:40.424776+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T21:00:40.424776+0000","last_undegraded":"2024-05-08T21:00:40.424776+0000","last_fullsized":"2024-05-08T21:00:40.424776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'30","last_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_deep_scrub":"22'30","last_deep_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.424482+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:18.189346+0000","scrub_duration":0.003259638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.558765+0000","last_change":"2024-05-08T21:00:53.558765+0000","last_active":"2024-05-08T21:00:53.558765+0000","last_peered":"2024-05-08T21:00:53.558765+0000","last_clean":"2024-05-08T21:00:53.558765+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:53.558765+0000","last_undegraded":"2024-05-08T21:00:53.558765+0000","last_fullsized":"2024-05-08T21:00:53.558765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:53.558327+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:53.558327+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.558327+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:16.162913+0000","scrub_duration":0.0039466500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'36","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.803499+0000","last_change":"2024-05-08T21:00:42.803499+0000","last_active":"2024-05-08T21:00:42.803499+0000","last_peered":"2024-05-08T21:00:42.803499+0000","last_clean":"2024-05-08T21:00:42.803499+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T21:00:42.803499+0000","last_undegraded":"2024-05-08T21:00:42.803499+0000","last_fullsized":"2024-05-08T21:00:42.803499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.803281+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:03.284450+0000","scrub_duration":0.013360945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:31.918445+0000","last_change":"2024-05-08T21:00:31.918445+0000","last_active":"2024-05-08T21:00:31.918445+0000","last_peered":"2024-05-08T21:00:31.918445+0000","last_clean":"2024-05-08T21:00:31.918445+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:31.918445+0000","last_undegraded":"2024-05-08T21:00:31.918445+0000","last_fullsized":"2024-05-08T21:00:31.918445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_clean_scrub_stamp":"2024-05-08T21:00:31.918115+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:56.866249+0000","scrub_duration":0.0031224640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.691488+0000","last_change":"2024-05-08T21:00:46.691488+0000","last_active":"2024-05-08T21:00:46.691488+0000","last_peered":"2024-05-08T21:00:46.691488+0000","last_clean":"2024-05-08T21:00:46.691488+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T21:00:46.691488+0000","last_undegraded":"2024-05-08T21:00:46.691488+0000","last_fullsized":"2024-05-08T21:00:46.691488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.691190+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:41.236171+0000","scrub_duration":0.007003202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:59.232859+0000","last_change":"2024-05-08T21:00:59.232859+0000","last_active":"2024-05-08T21:00:59.232859+0000","last_peered":"2024-05-08T21:00:59.232859+0000","last_clean":"2024-05-08T21:00:59.232859+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:59.232859+0000","last_undegraded":"2024-05-08T21:00:59.232859+0000","last_fullsized":"2024-05-08T21:00:59.232859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2024-05-08T21:00:59.232536+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2024-05-08T21:00:59.232536+0000","last_clean_scrub_stamp":"2024-05-08T21:00:59.232536+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:04.248104+0000","scrub_duration":0.0030277139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.854245+0000","last_change":"2024-05-08T21:00:47.854245+0000","last_active":"2024-05-08T21:00:47.854245+0000","last_peered":"2024-05-08T21:00:47.854245+0000","last_clean":"2024-05-08T21:00:47.854245+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T21:00:47.854245+0000","last_undegraded":"2024-05-08T21:00:47.854245+0000","last_fullsized":"2024-05-08T21:00:47.854245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.853909+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.574319+0000","scrub_duration":0.0059207569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:10.149615+0000","last_change":"2024-05-08T21:01:10.149615+0000","last_active":"2024-05-08T21:01:10.149615+0000","last_peered":"2024-05-08T21:01:10.149615+0000","last_clean":"2024-05-08T21:01:10.149615+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:01:10.149615+0000","last_undegraded":"2024-05-08T21:01:10.149615+0000","last_fullsized":"2024-05-08T21:01:10.149615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2024-05-08T21:01:10.149315+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2024-05-08T21:01:10.149315+0000","last_clean_scrub_stamp":"2024-05-08T21:01:10.149315+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:38.547505+0000","scrub_duration":0.0031567610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'25","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.771270+0000","last_change":"2024-05-08T21:00:33.771270+0000","last_active":"2024-05-08T21:00:33.771270+0000","last_peered":"2024-05-08T21:00:33.771270+0000","last_clean":"2024-05-08T21:00:33.771270+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T21:00:33.771270+0000","last_undegraded":"2024-05-08T21:00:33.771270+0000","last_fullsized":"2024-05-08T21:00:33.771270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.771004+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.252173+0000","scrub_duration":0.006918853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:49.394251+0000","last_change":"2024-05-08T21:00:49.394251+0000","last_active":"2024-05-08T21:00:49.394251+0000","last_peered":"2024-05-08T21:00:49.394251+0000","last_clean":"2024-05-08T21:00:49.394251+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:49.394251+0000","last_undegraded":"2024-05-08T21:00:49.394251+0000","last_fullsized":"2024-05-08T21:00:49.394251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:49.393950+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:49.393950+0000","last_clean_scrub_stamp":"2024-05-08T21:00:49.393950+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:57.512471+0000","scrub_duration":0.0037924870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.796298+0000","last_change":"2024-05-08T21:00:41.796298+0000","last_active":"2024-05-08T21:00:41.796298+0000","last_peered":"2024-05-08T21:00:41.796298+0000","last_clean":"2024-05-08T21:00:41.796298+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T21:00:41.796298+0000","last_undegraded":"2024-05-08T21:00:41.796298+0000","last_fullsized":"2024-05-08T21:00:41.796298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'29","last_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_deep_scrub":"22'29","last_deep_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.795973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:36.340955+0000","scrub_duration":0.003348916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:11.168991+0000","last_change":"2024-05-08T21:01:11.168991+0000","last_active":"2024-05-08T21:01:11.168991+0000","last_peered":"2024-05-08T21:01:11.168991+0000","last_clean":"2024-05-08T21:01:11.168991+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:01:11.168991+0000","last_undegraded":"2024-05-08T21:01:11.168991+0000","last_fullsized":"2024-05-08T21:01:11.168991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:01:11.168700+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:01:11.168700+0000","last_clean_scrub_stamp":"2024-05-08T21:01:11.168700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:46.778730+0000","scrub_duration":0.0036335180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.002791+0000","last_change":"2024-05-08T21:00:40.003115+0000","last_active":"2024-05-08T21:00:40.002791+0000","last_peered":"2024-05-08T21:00:40.002791+0000","last_clean":"2024-05-08T21:00:40.002791+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T21:00:40.002791+0000","last_undegraded":"2024-05-08T21:00:40.002791+0000","last_fullsized":"2024-05-08T21:00:40.002791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.002743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:04.204746+0000","scrub_duration":0.010423897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.434755+0000","last_change":"2024-05-08T21:00:34.434755+0000","last_active":"2024-05-08T21:00:34.434755+0000","last_peered":"2024-05-08T21:00:34.434755+0000","last_clean":"2024-05-08T21:00:34.434755+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T21:00:34.434755+0000","last_undegraded":"2024-05-08T21:00:34.434755+0000","last_fullsized":"2024-05-08T21:00:34.434755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.434434+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:09.727644+0000","scrub_duration":0.0038574659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.754455+0000","last_change":"2024-05-08T21:00:56.754702+0000","last_active":"2024-05-08T21:00:56.754455+0000","last_peered":"2024-05-08T21:00:56.754455+0000","last_clean":"2024-05-08T21:00:56.754455+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:56.754455+0000","last_undegraded":"2024-05-08T21:00:56.754455+0000","last_fullsized":"2024-05-08T21:00:56.754455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2024-05-08T21:00:56.754402+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2024-05-08T21:00:56.754402+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.754402+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:39.840158+0000","scrub_duration":0.0039386769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.042986+0000","last_change":"2024-05-08T21:00:42.042986+0000","last_active":"2024-05-08T21:00:42.042986+0000","last_peered":"2024-05-08T21:00:42.042986+0000","last_clean":"2024-05-08T21:00:42.042986+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T21:00:42.042986+0000","last_undegraded":"2024-05-08T21:00:42.042986+0000","last_fullsized":"2024-05-08T21:00:42.042986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.042532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:21.469667+0000","scrub_duration":0.0045502980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.284423+0000","last_change":"2024-05-08T21:00:52.284423+0000","last_active":"2024-05-08T21:00:52.284423+0000","last_peered":"2024-05-08T21:00:52.284423+0000","last_clean":"2024-05-08T21:00:52.284423+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:52.284423+0000","last_undegraded":"2024-05-08T21:00:52.284423+0000","last_fullsized":"2024-05-08T21:00:52.284423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:52.284118+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:52.284118+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.284118+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:14.888704+0000","scrub_duration":0.0025655999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'74","reported_seq":145,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.858180+0000","last_change":"2024-05-08T21:00:45.858180+0000","last_active":"2024-05-08T21:00:45.858180+0000","last_peered":"2024-05-08T21:00:45.858180+0000","last_clean":"2024-05-08T21:00:45.858180+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:45.858180+0000","last_undegraded":"2024-05-08T21:00:45.858180+0000","last_fullsized":"2024-05-08T21:00:45.858180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'74","last_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_deep_scrub":"22'74","last_deep_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.857839+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:56.229464+0000","scrub_duration":0.0081842159999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:02.540795+0000","last_change":"2024-05-08T21:01:02.541036+0000","last_active":"2024-05-08T21:01:02.540795+0000","last_peered":"2024-05-08T21:01:02.540795+0000","last_clean":"2024-05-08T21:01:02.540795+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:01:02.540795+0000","last_undegraded":"2024-05-08T21:01:02.540795+0000","last_fullsized":"2024-05-08T21:01:02.540795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:01:02.540747+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:01:02.540747+0000","last_clean_scrub_stamp":"2024-05-08T21:01:02.540747+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:06.283618+0000","scrub_duration":0.0034748729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.479144+0000","last_change":"2024-05-08T21:00:32.479144+0000","last_active":"2024-05-08T21:00:32.479144+0000","last_peered":"2024-05-08T21:00:32.479144+0000","last_clean":"2024-05-08T21:00:32.479144+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T21:00:32.479144+0000","last_undegraded":"2024-05-08T21:00:32.479144+0000","last_fullsized":"2024-05-08T21:00:32.479144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.478860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:42.850485+0000","scrub_duration":0.0033808480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.699970+0000","last_change":"2024-05-08T21:00:50.699970+0000","last_active":"2024-05-08T21:00:50.699970+0000","last_peered":"2024-05-08T21:00:50.699970+0000","last_clean":"2024-05-08T21:00:50.699970+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:50.699970+0000","last_undegraded":"2024-05-08T21:00:50.699970+0000","last_fullsized":"2024-05-08T21:00:50.699970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:50.699594+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:50.699594+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.699594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.071219+0000","scrub_duration":0.0030293310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:36.678387+0000","last_change":"2024-05-08T21:00:36.678387+0000","last_active":"2024-05-08T21:00:36.678387+0000","last_peered":"2024-05-08T21:00:36.678387+0000","last_clean":"2024-05-08T21:00:36.678387+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T21:00:36.678387+0000","last_undegraded":"2024-05-08T21:00:36.678387+0000","last_fullsized":"2024-05-08T21:00:36.678387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'22","last_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_deep_scrub":"22'22","last_deep_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_clean_scrub_stamp":"2024-05-08T21:00:36.678044+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:47.049669+0000","scrub_duration":0.0036330770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.353197+0000","last_change":"2024-05-08T21:00:42.353197+0000","last_active":"2024-05-08T21:00:42.353197+0000","last_peered":"2024-05-08T21:00:42.353197+0000","last_clean":"2024-05-08T21:00:42.353197+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:42.353197+0000","last_undegraded":"2024-05-08T21:00:42.353197+0000","last_fullsized":"2024-05-08T21:00:42.353197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.352656+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:25.438411+0000","scrub_duration":0.003835003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.093337+0000","last_change":"2024-05-08T21:00:44.093337+0000","last_active":"2024-05-08T21:00:44.093337+0000","last_peered":"2024-05-08T21:00:44.093337+0000","last_clean":"2024-05-08T21:00:44.093337+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T21:00:44.093337+0000","last_undegraded":"2024-05-08T21:00:44.093337+0000","last_fullsized":"2024-05-08T21:00:44.093337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.092882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:27.178637+0000","scrub_duration":0.0040887049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.788249+0000","last_change":"2024-05-08T21:00:46.788249+0000","last_active":"2024-05-08T21:00:46.788249+0000","last_peered":"2024-05-08T21:00:46.788249+0000","last_clean":"2024-05-08T21:00:46.788249+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:46.788249+0000","last_undegraded":"2024-05-08T21:00:46.788249+0000","last_fullsized":"2024-05-08T21:00:46.788249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.787793+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:09.392379+0000","scrub_duration":0.0034348349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'41","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.788225+0000","last_change":"2024-05-08T21:00:44.788225+0000","last_active":"2024-05-08T21:00:44.788225+0000","last_peered":"2024-05-08T21:00:44.788225+0000","last_clean":"2024-05-08T21:00:44.788225+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:44.788225+0000","last_undegraded":"2024-05-08T21:00:44.788225+0000","last_fullsized":"2024-05-08T21:00:44.788225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.787841+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:24.841564+0000","scrub_duration":0.0082866180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.683673+0000","last_change":"2024-05-08T21:00:39.683673+0000","last_active":"2024-05-08T21:00:39.683673+0000","last_peered":"2024-05-08T21:00:39.683673+0000","last_clean":"2024-05-08T21:00:39.683673+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:39.683673+0000","last_undegraded":"2024-05-08T21:00:39.683673+0000","last_fullsized":"2024-05-08T21:00:39.683673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.683380+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:14.976590+0000","scrub_duration":0.003306767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'27","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.384556+0000","last_change":"2024-05-08T21:00:39.384556+0000","last_active":"2024-05-08T21:00:39.384556+0000","last_peered":"2024-05-08T21:00:39.384556+0000","last_clean":"2024-05-08T21:00:39.384556+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:39.384556+0000","last_undegraded":"2024-05-08T21:00:39.384556+0000","last_fullsized":"2024-05-08T21:00:39.384556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'27","last_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_deep_scrub":"22'27","last_deep_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.384259+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:16.686736+0000","scrub_duration":0.0058410570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.293555+0000","last_change":"2024-05-08T21:00:50.293555+0000","last_active":"2024-05-08T21:00:50.293555+0000","last_peered":"2024-05-08T21:00:50.293555+0000","last_clean":"2024-05-08T21:00:50.293555+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:50.293555+0000","last_undegraded":"2024-05-08T21:00:50.293555+0000","last_fullsized":"2024-05-08T21:00:50.293555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:50.293260+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:50.293260+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.293260+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:30.346983+0000","scrub_duration":0.0036686290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:51.139818+0000","last_change":"2024-05-08T21:00:51.139818+0000","last_active":"2024-05-08T21:00:51.139818+0000","last_peered":"2024-05-08T21:00:51.139818+0000","last_clean":"2024-05-08T21:00:51.139818+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T21:00:51.139818+0000","last_undegraded":"2024-05-08T21:00:51.139818+0000","last_fullsized":"2024-05-08T21:00:51.139818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:51.139546+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:51.139546+0000","last_clean_scrub_stamp":"2024-05-08T21:00:51.139546+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:59.258067+0000","scrub_duration":0.0035273180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.704505+0000","last_change":"2024-05-08T21:00:52.704505+0000","last_active":"2024-05-08T21:00:52.704505+0000","last_peered":"2024-05-08T21:00:52.704505+0000","last_clean":"2024-05-08T21:00:52.704505+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:52.704505+0000","last_undegraded":"2024-05-08T21:00:52.704505+0000","last_fullsized":"2024-05-08T21:00:52.704505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:00:52.704080+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:00:52.704080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.704080+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:28.424490+0000","scrub_duration":0.003400602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.719141+0000","last_change":"2024-05-08T21:00:32.719141+0000","last_active":"2024-05-08T21:00:32.719141+0000","last_peered":"2024-05-08T21:00:32.719141+0000","last_clean":"2024-05-08T21:00:32.719141+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T21:00:32.719141+0000","last_undegraded":"2024-05-08T21:00:32.719141+0000","last_fullsized":"2024-05-08T21:00:32.719141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.718866+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:27.263848+0000","scrub_duration":0.0035823880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.605987+0000","last_change":"2024-05-08T21:01:01.605987+0000","last_active":"2024-05-08T21:01:01.605987+0000","last_peered":"2024-05-08T21:01:01.605987+0000","last_clean":"2024-05-08T21:01:01.605987+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:01:01.605987+0000","last_undegraded":"2024-05-08T21:01:01.605987+0000","last_fullsized":"2024-05-08T21:01:01.605987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:01:01.605708+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:01:01.605708+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.605708+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:52.320824+0000","scrub_duration":0.003097392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.673744+0000","last_change":"2024-05-08T21:00:38.673744+0000","last_active":"2024-05-08T21:00:38.673744+0000","last_peered":"2024-05-08T21:00:38.673744+0000","last_clean":"2024-05-08T21:00:38.673744+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T21:00:38.673744+0000","last_undegraded":"2024-05-08T21:00:38.673744+0000","last_fullsized":"2024-05-08T21:00:38.673744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'31","last_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_deep_scrub":"22'31","last_deep_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.673453+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:14.393863+0000","scrub_duration":0.0031815139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.654995+0000","last_change":"2024-05-08T21:00:45.654995+0000","last_active":"2024-05-08T21:00:45.654995+0000","last_peered":"2024-05-08T21:00:45.654995+0000","last_clean":"2024-05-08T21:00:45.654995+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:45.654995+0000","last_undegraded":"2024-05-08T21:00:45.654995+0000","last_fullsized":"2024-05-08T21:00:45.654995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.654690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:09.856693+0000","scrub_duration":0.0034274710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'520","reported_seq":547,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.091282+0000","last_change":"2024-05-08T21:00:43.091282+0000","last_active":"2024-05-08T21:00:43.091282+0000","last_peered":"2024-05-08T21:00:43.091282+0000","last_clean":"2024-05-08T21:00:43.091282+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T21:00:43.091282+0000","last_undegraded":"2024-05-08T21:00:43.091282+0000","last_fullsized":"2024-05-08T21:00:43.091282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'520","last_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_deep_scrub":"22'520","last_deep_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.091097+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:05.695683+0000","scrub_duration":0.019677249000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.583671+0000","last_change":"2024-05-08T21:00:52.583671+0000","last_active":"2024-05-08T21:00:52.583671+0000","last_peered":"2024-05-08T21:00:52.583671+0000","last_clean":"2024-05-08T21:00:52.583671+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:52.583671+0000","last_undegraded":"2024-05-08T21:00:52.583671+0000","last_fullsized":"2024-05-08T21:00:52.583671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:52.583366+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:52.583366+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.583366+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:32.010501+0000","scrub_duration":0.0031708209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.479826+0000","last_change":"2024-05-08T21:00:56.480126+0000","last_active":"2024-05-08T21:00:56.479826+0000","last_peered":"2024-05-08T21:00:56.479826+0000","last_clean":"2024-05-08T21:00:56.479826+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:56.479826+0000","last_undegraded":"2024-05-08T21:00:56.479826+0000","last_fullsized":"2024-05-08T21:00:56.479826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:56.479773+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:56.479773+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.479773+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.495341+0000","scrub_duration":0.0032261310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'17","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.090009+0000","last_change":"2024-05-08T21:00:46.090256+0000","last_active":"2024-05-08T21:00:46.090009+0000","last_peered":"2024-05-08T21:00:46.090009+0000","last_clean":"2024-05-08T21:00:46.090009+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T21:00:46.090009+0000","last_undegraded":"2024-05-08T21:00:46.090009+0000","last_fullsized":"2024-05-08T21:00:46.090009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'17","last_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_deep_scrub":"22'17","last_deep_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.089958+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:35.049023+0000","scrub_duration":0.0058691460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.756790+0000","last_change":"2024-05-08T21:00:58.757107+0000","last_active":"2024-05-08T21:00:58.756790+0000","last_peered":"2024-05-08T21:00:58.756790+0000","last_clean":"2024-05-08T21:00:58.756790+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:58.756790+0000","last_undegraded":"2024-05-08T21:00:58.756790+0000","last_fullsized":"2024-05-08T21:00:58.756790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:58.756740+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:58.756740+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.756740+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:47.715805+0000","scrub_duration":0.0033771059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.228745+0000","last_change":"2024-05-08T21:00:56.228903+0000","last_active":"2024-05-08T21:00:56.228745+0000","last_peered":"2024-05-08T21:00:56.228745+0000","last_clean":"2024-05-08T21:00:56.228745+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:56.228745+0000","last_undegraded":"2024-05-08T21:00:56.228745+0000","last_fullsized":"2024-05-08T21:00:56.228745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:56.228718+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:56.228718+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.228718+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:46.943834+0000","scrub_duration":0.017730162000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.276376+0000","last_change":"2024-05-08T21:00:53.276376+0000","last_active":"2024-05-08T21:00:53.276376+0000","last_peered":"2024-05-08T21:00:53.276376+0000","last_clean":"2024-05-08T21:00:53.276376+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:53.276376+0000","last_undegraded":"2024-05-08T21:00:53.276376+0000","last_fullsized":"2024-05-08T21:00:53.276376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2024-05-08T21:00:53.276033+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2024-05-08T21:00:53.276033+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.276033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.361788+0000","scrub_duration":0.0035727010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'44","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:35.712444+0000","last_change":"2024-05-08T21:00:35.712444+0000","last_active":"2024-05-08T21:00:35.712444+0000","last_peered":"2024-05-08T21:00:35.712444+0000","last_clean":"2024-05-08T21:00:35.712444+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T21:00:35.712444+0000","last_undegraded":"2024-05-08T21:00:35.712444+0000","last_fullsized":"2024-05-08T21:00:35.712444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_clean_scrub_stamp":"2024-05-08T21:00:35.712232+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:13.477096+0000","scrub_duration":0.017292459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:57.578188+0000","last_change":"2024-05-08T21:00:57.578418+0000","last_active":"2024-05-08T21:00:57.578188+0000","last_peered":"2024-05-08T21:00:57.578188+0000","last_clean":"2024-05-08T21:00:57.578188+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:57.578188+0000","last_undegraded":"2024-05-08T21:00:57.578188+0000","last_fullsized":"2024-05-08T21:00:57.578188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:57.578136+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:57.578136+0000","last_clean_scrub_stamp":"2024-05-08T21:00:57.578136+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:05.696657+0000","scrub_duration":0.0035239300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'52","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.425346+0000","last_change":"2024-05-08T21:00:39.425346+0000","last_active":"2024-05-08T21:00:39.425346+0000","last_peered":"2024-05-08T21:00:39.425346+0000","last_clean":"2024-05-08T21:00:39.425346+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T21:00:39.425346+0000","last_undegraded":"2024-05-08T21:00:39.425346+0000","last_fullsized":"2024-05-08T21:00:39.425346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.425092+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:59.906261+0000","scrub_duration":0.020912884999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090874,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3114,"num_write_kb":31562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3851,"ondisk_log_size":3851,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77300000000000002,"15min":0.80600000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.01,"5min":1.22,"15min":1.22},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83299999999999996,"15min":0.84499999999999997},"min":{"1min":0.56799999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1659999999999999,"5min":1.254,"15min":1.254},"last":0.90200000000000002}]},{"osd":1,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.91200000000000003,"15min":0.93500000000000005},"min":{"1min":0.68000000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.137,"5min":1.298,"15min":1.298},"last":1.085},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94499999999999995,"15min":0.98899999999999999},"min":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1819999999999999}]},{"osd":2,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.92200000000000004,"15min":0.97099999999999997},"min":{"1min":0.51000000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1719999999999999,"5min":1.274,"15min":1.274},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.96799999999999997,"15min":1.032},"min":{"1min":0.58599999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.214,"5min":1.399,"15min":1.399},"last":0.98899999999999999}]},{"osd":3,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.87},"min":{"1min":0.62,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1890000000000001,"5min":1.319,"15min":1.319},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.01,"15min":1.085},"min":{"1min":0.69999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.25,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.018}]},{"osd":4,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.91700000000000004,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1890000000000001,"5min":1.425,"15min":1.425},"last":0.629},{"interface":"front","average":{"1min":0.92300000000000004,"5min":1.02,"15min":1.0649999999999999},"min":{"1min":0.67600000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.1220000000000001,"5min":1.397,"15min":1.397},"last":0.95099999999999996}]},{"osd":5,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.0329999999999999,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.347,"5min":1.425,"15min":1.425},"last":1.22},{"interface":"front","average":{"1min":1.02,"5min":1.0940000000000001,"15min":1.135},"min":{"1min":0.77400000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3029999999999999,"5min":1.734,"15min":1.734},"last":1.0629999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:41 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1299999999999999,"15min":1.171},"min":{"1min":0.81899999999999995,"5min":0.63,"15min":0.63},"max":{"1min":1.286,"5min":1.821,"15min":1.821},"last":1.107},{"interface":"front","average":{"1min":1.095,"5min":1.149,"15min":1.1930000000000001},"min":{"1min":0.83399999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.2609999999999999,"5min":1.45,"15min":1.45},"last":1.1559999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14039081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.86399999999999999,"15min":0.92200000000000004},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.84799999999999998,"15min":0.91400000000000003},"min":{"1min":0.58599999999999997,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.044,"5min":1.343,"15min":1.343},"last":1.0209999999999999}]},{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.91200000000000003,"15min":0.98299999999999998},"min":{"1min":0.60299999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0960000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":1.02},"min":{"1min":0.68400000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2190000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.1439999999999999}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83999999999999997,"15min":0.876},"min":{"1min":0.53600000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0609999999999999,"5min":1.163,"15min":1.163},"last":1.075},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89400000000000002,"15min":0.92000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.155,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.748}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.91900000000000004,"15min":0.96199999999999997},"min":{"1min":0.68300000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.173,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.90000000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1160000000000001,"5min":1.258,"15min":1.258},"last":0.88700000000000001}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.88800000000000001,"15min":0.90000000000000002},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2609999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.96199999999999997,"5min":1.0009999999999999,"15min":1.0389999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3069999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.94399999999999995}]},{"osd":5,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96599999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.117,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":1.0860000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3360000000000001,"5min":1.403,"15min":1.403},"last":0.96799999999999997}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1100000000000001,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.377,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.083,"15min":1.111},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2310000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.99399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.85199999999999998},"min":{"1min":0.443,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":1.173,"15min":1.173},"last":0.751},{"interface":"front","average":{"1min":0.873,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.57699999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.137,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.67100000000000004}]},{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.86099999999999999,"15min":0.84999999999999998},"min":{"1min":0.63700000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1890000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.85599999999999998},"min":{"1min":0.60499999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0960000000000001,"5min":1.256,"15min":1.256},"last":1.0409999999999999}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.879,"15min":0.89500000000000002},"min":{"1min":0.61899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.163,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88400000000000001,"15min":0.92500000000000004},"min":{"1min":0.66800000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.109,"5min":1.401,"15min":1.401},"last":0.92600000000000005}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91600000000000004,"15min":0.95299999999999996},"min":{"1min":0.65000000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0900000000000001,"5min":1.256,"15min":1.256},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.95499999999999996,"15min":0.96399999999999997},"min":{"1min":0.81799999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.1830000000000001,"5min":1.341,"15min":1.341},"last":1.119}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.93999999999999995,"15min":0.95899999999999996},"min":{"1min":0.59399999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.175,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.98099999999999998,"15min":0.999},"min":{"1min":0.622,"5min":0.505,"15min":0.505},"max":{"1min":1.153,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.89100000000000001}]},{"osd":6,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.0369999999999999,"15min":1.0549999999999999},"min":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.256,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.054,"15min":1.0800000000000001},"min":{"1min":0.53600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2170000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.999}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.071,"15min":1.075},"min":{"1min":0.66500000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4119999999999999,"5min":1.423,"15min":1.423},"last":1.056},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.139,"15min":1.175},"min":{"1min":0.71999999999999997,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3480000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3640000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81200000000000006,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.88100000000000001,"15min":0.92700000000000005},"min":{"1min":0.51600000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2609999999999999,"5min":1.466,"15min":1.466},"last":0.92100000000000004}]},{"osd":1,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.51900000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0609999999999999,"5min":1.292,"15min":1.292},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.90000000000000002,"15min":0.94199999999999995},"min":{"1min":0.57799999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3700000000000001,"5min":1.556,"15min":1.556},"last":0.95399999999999996}]},{"osd":2,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.57799999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0880000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85799999999999998,"15min":0.89000000000000001},"min":{"1min":0.57799999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.123,"5min":1.264,"15min":1.264},"last":0.88600000000000001}]},{"osd":3,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.91200000000000003,"15min":0.94199999999999995},"min":{"1min":0.746,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.3220000000000001,"5min":1.613,"15min":1.613},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.96299999999999997,"15min":1},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2250000000000001,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.0109999999999999}]},{"osd":5,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.0820000000000001,"15min":1.0960000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.7480000000000002,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.85899999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.99299999999999999,"15min":1.0449999999999999},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.347,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.036,"5min":0.999,"15min":1.02},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.375,"5min":1.784,"15min":1.784},"last":0.75800000000000001}]},{"osd":7,"last update":"Wed May 8 21:00:40 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0669999999999999,"15min":1.087},"min":{"1min":0.63300000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5529999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.083,"5min":1.1100000000000001,"15min":1.149},"min":{"1min":0.61599999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.419,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.83299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.624,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.71199999999999997,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.88700000000000001,"5min":1.109,"15min":1.109},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.72599999999999998},"min":{"1min":0.442,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.47299999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.89400000000000002,"5min":1.075,"15min":1.075},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.45000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.98499999999999999,"5min":1.671,"15min":1.671},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.77600000000000002,"15min":0.80000000000000004},"min":{"1min":0.57399999999999995,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.024,"5min":1.302,"15min":1.302},"last":0.66700000000000004}]},{"osd":4,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.98499999999999999,"15min":1.014},"min":{"1min":0.78300000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3200000000000001,"5min":1.522,"15min":1.522},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0369999999999999,"15min":1.052},"min":{"1min":0.65800000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.4139999999999999,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.93600000000000005}]},{"osd":5,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.0029999999999999,"15min":1.0229999999999999},"min":{"1min":0.64400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.3859999999999999,"5min":1.994,"15min":1.994},"last":1.258},{"interface":"front","average":{"1min":0.96899999999999997,"5min":1.048,"15min":1.0940000000000001},"min":{"1min":0.76600000000000001,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2649999999999999,"5min":2.198,"15min":2.198},"last":1.0089999999999999}]},{"osd":6,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.069,"15min":1.099},"min":{"1min":0.72299999999999998,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.145,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.085,"15min":1.115},"min":{"1min":0.76500000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1759999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.202}]},{"osd":7,"last update":"Wed May 8 21:00:37 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.1120000000000001,"15min":1.1639999999999999},"min":{"1min":0.77900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.4730000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.099,"5min":1.1379999999999999,"15min":1.1619999999999999},"min":{"1min":0.78800000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.393,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.03}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.29899999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.437,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85099999999999998,"5min":0.996,"15min":0.996},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.244,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.78400000000000003},"min":{"1min":0.47299999999999998,"5min":0.311,"15min":0.311},"max":{"1min":1.274,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.69299999999999995}]},{"osd":3,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.377},"max":{"1min":1.014,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.90400000000000003}]},{"osd":4,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96599999999999997,"15min":0.96299999999999997},"min":{"1min":0.57999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.2310000000000001,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.96599999999999997,"15min":0.996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.194,"5min":1.577,"15min":1.577},"last":0.98599999999999999}]},{"osd":5,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.96699999999999997,"15min":1.0269999999999999},"min":{"1min":0.41699999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2470000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.024,"5min":1.036,"15min":1.0589999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.651,"5min":1.8,"15min":1.8},"last":1.2290000000000001}]},{"osd":6,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0029999999999999,"15min":1.0369999999999999},"min":{"1min":0.63700000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.1899999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.046},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0149999999999999,"15min":1.097},"min":{"1min":0.66100000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.155,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.88700000000000001}]},{"osd":7,"last update":"Wed May 8 21:00:35 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0249999999999999,"15min":1.042},"min":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.258,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.0620000000000001,"15min":1.1379999999999999},"min":{"1min":0.61599999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.95699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.621},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.70499999999999996},"min":{"1min":0.42899999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.94299999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.66100000000000003},"min":{"1min":0.47899999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.871,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0900000000000001,"5min":1.294,"15min":1.294},"last":0.77300000000000002}]},{"osd":3,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77200000000000002,"15min":0.78400000000000003},"min":{"1min":0.56799999999999995,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.173,"15min":1.173},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.55600000000000005,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.99399999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1879999999999999,"5min":1.26,"15min":1.26},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.96199999999999997,"15min":1.0069999999999999},"min":{"1min":0.79400000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.137,"5min":1.901,"15min":1.901},"last":0.80800000000000005}]},{"osd":5,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.024,"15min":1.089},"min":{"1min":0.72899999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.276,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.745},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.04,"15min":1.042},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98299999999999998}]},{"osd":6,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0429999999999999,"15min":1.085},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2130000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.083},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0840000000000001,"15min":1.133},"min":{"1min":0.83899999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.282,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.89000000000000001}]},{"osd":7,"last update":"Wed May 8 21:00:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0760000000000001,"15min":1.0900000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.399,"5min":1.663,"15min":1.663},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.095,"15min":1.137},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3839999999999999,"5min":2.02,"15min":2.02},"last":1.282}]}]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.59799999999999998},"min":{"1min":0.45300000000000001,"5min":0.251,"15min":0.251},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68700000000000006,"15min":0.70199999999999996},"min":{"1min":0.55600000000000005,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.88100000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72099999999999997},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.73199999999999998},"min":{"1min":0.51600000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.98299999999999998,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.86699999999999999}]},{"osd":3,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.71399999999999997,"15min":0.80800000000000005},"min":{"1min":0.47099999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.877,"15min":0.97799999999999998},"min":{"1min":0.48799999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.282,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.96399999999999997}]},{"osd":4,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91700000000000004,"15min":0.91900000000000004},"min":{"1min":0.52500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":1.1739999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.92400000000000004,"15min":0.93899999999999995},"min":{"1min":0.70399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.073,"5min":1.3,"15min":1.3},"last":1.099}]},{"osd":5,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.88400000000000001,"15min":0.89700000000000002},"min":{"1min":0.66500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.173,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.325},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.96499999999999997,"15min":0.95899999999999996},"min":{"1min":0.75700000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.23}]},{"osd":6,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.996},"min":{"1min":0.72799999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.125,"15min":1.298},"min":{"1min":0.63,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.181,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":1.071}]},{"osd":7,"last update":"Wed May 8 21:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.98499999999999999,"15min":0.998},"min":{"1min":0.69199999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.143,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.006,"15min":1.04},"min":{"1min":0.75700000000000001,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.177,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.169}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:01:33.029 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T20:56:41.384468+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=20, tm_min=56, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=21, tm_min=0, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T21:01:33.030 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T21:01:41.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:41.443 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:01:53.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T21:01:53.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 Processor -- start 2024-05-08T21:01:53.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 -- start start 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60ac071ab0 0x7f60ac0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac071e90 0x7f60ac15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac0cea50 con 0x7f60ac15aaa0 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0ce080 con 0x7f60ac071ab0 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60abfff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0cd7c0 con 0x7f60ac071e90 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60aaffd700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f60ac071ab0 0x7f60ac0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60ab7fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f60ac15aaa0 0x7f60ac13d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50094/0 (socket says 172.21.15.107:50094) 2024-05-08T21:01:53.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60ab7fe700 1 -- 172.21.15.107:0/4043361014 learned_addr learned my addr 172.21.15.107:0/4043361014 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:53.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.146+0000 7f60aa7fc700 1 --2- 172.21.15.107:0/4043361014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac071e90 0x7f60ac15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60aaffd700 1 -- 172.21.15.107:0/4043361014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac071e90 msgr2=0x7f60ac15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60a9ffb700 1 -- 172.21.15.107:0/4043361014 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259649817 0 0) 0x7f60a4001490 con 0x7f60ac15aaa0 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60aaffd700 1 --2- 172.21.15.107:0/4043361014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac071e90 0x7f60ac15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60aaffd700 1 -- 172.21.15.107:0/4043361014 >> v1:172.21.15.107:6789/0 conn(0x7f60ac15aaa0 legacy=0x7f60ac13d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60aaffd700 1 -- 172.21.15.107:0/4043361014 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0cda30 con 0x7f60ac071ab0 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60aaffd700 1 --2- 172.21.15.107:0/4043361014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac0ce510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009850 tx=0x7f60a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6e120f1711a158 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60a9ffb700 1 -- 172.21.15.107:0/4043361014 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0011830 con 0x7f60ac071ab0 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60a9ffb700 1 -- 172.21.15.107:0/4043361014 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0011990 con 0x7f60ac071ab0 2024-05-08T21:01:53.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60a9ffb700 1 -- 172.21.15.107:0/4043361014 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0011d40 con 0x7f60ac071ab0 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 -- 172.21.15.107:0/4043361014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 msgr2=0x7f60ac0ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 --2- 172.21.15.107:0/4043361014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac0ce510 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009850 tx=0x7f60a0009b60 comp rx=0 tx=0).stop 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 -- 172.21.15.107:0/4043361014 shutdown_connections 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 --2- 172.21.15.107:0/4043361014 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac071e90 0x7f60ac15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 --2- 172.21.15.107:0/4043361014 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac0ce510 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 -- 172.21.15.107:0/4043361014 >> 172.21.15.107:0/4043361014 conn(0x7f60ac06c330 msgr2=0x7f60ac06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 -- 172.21.15.107:0/4043361014 shutdown_connections 2024-05-08T21:01:53.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.150+0000 7f60abfff700 1 -- 172.21.15.107:0/4043361014 wait complete. 2024-05-08T21:01:53.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 Processor -- start 2024-05-08T21:01:53.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 -- start start 2024-05-08T21:01:53.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac13ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60ac071e90 0x7f60ac13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac15aaa0 0x7f60ac1538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac13e840 con 0x7f60ac071ab0 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac13dd00 con 0x7f60ac071e90 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60abfff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac13dfe0 con 0x7f60ac15aaa0 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60aaffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac13ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60aaffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac13ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45774/0 (socket says 172.21.15.107:45774) 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60aaffd700 1 -- 172.21.15.107:0/1003927751 learned_addr learned my addr 172.21.15.107:0/1003927751 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60ab7fe700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac15aaa0 0x7f60ac1538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60aa7fc700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60ac071e90 0x7f60ac13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.154+0000 7f60aaffd700 1 -- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac15aaa0 msgr2=0x7f60ac1538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60aaffd700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac15aaa0 0x7f60ac1538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60aaffd700 1 -- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60ac071e90 msgr2=0x7f60ac13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60aaffd700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60ac071e90 0x7f60ac13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60aaffd700 1 -- 172.21.15.107:0/1003927751 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00094b0 con 0x7f60ac071ab0 2024-05-08T21:01:53.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60aaffd700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac13ae50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60a0014040 tx=0x7f60a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0019980 con 0x7f60ac071ab0 2024-05-08T21:01:53.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a001e070 con 0x7f60ac071ab0 2024-05-08T21:01:53.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0019d40 con 0x7f60ac071ab0 2024-05-08T21:01:53.167 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac13e2c0 con 0x7f60ac071ab0 2024-05-08T21:01:53.168 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac13b390 con 0x7f60ac071ab0 2024-05-08T21:01:53.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.158+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac13ecd0 con 0x7f60ac071ab0 2024-05-08T21:01:53.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.162+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f60a002d450 con 0x7f60ac071ab0 2024-05-08T21:01:53.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.162+0000 7f60937fe700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6098066730 0x7f6098068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.162+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f60a0085310 con 0x7f60ac071ab0 2024-05-08T21:01:53.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.162+0000 7f60aa7fc700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6098066730 0x7f6098068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.169 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.162+0000 7f60aa7fc700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6098066730 0x7f6098068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60ac154630 tx=0x7f609c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.166+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f60a0052720 con 0x7f60ac071ab0 2024-05-08T21:01:53.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.338+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 --> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60ac15b2c0 con 0x7f6098066730 2024-05-08T21:01:53.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.354+0000 7f60937fe700 1 -- 172.21.15.107:0/1003927751 <== mgr.4108 v2:172.21.15.107:6832/25996 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289784 (secure 0 0 0) 0x7f609c011810 con 0x7f6098066730 2024-05-08T21:01:53.366 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6098066730 msgr2=0x7f6098068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6098066730 0x7f6098068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60ac154630 tx=0x7f609c009240 comp rx=0 tx=0).stop 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 msgr2=0x7f60ac13ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac13ae50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60a0014040 tx=0x7f60a0004770 comp rx=0 tx=0).stop 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 shutdown_connections 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f6098066730 0x7f6098068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f60ac15aaa0 0x7f60ac1538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f60ac071e90 0x7f60ac13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 --2- 172.21.15.107:0/1003927751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f60ac071ab0 0x7f60ac13ae50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 >> 172.21.15.107:0/1003927751 conn(0x7f60ac06c330 msgr2=0x7f60ac06d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:53.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 shutdown_connections 2024-05-08T21:01:53.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.358+0000 7f60abfff700 1 -- 172.21.15.107:0/1003927751 wait complete. 2024-05-08T21:01:53.370 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-08T21:01:53.381 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-05-08T21:01:52.804558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":31681242,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":160,"num_read_kb":475,"num_write":3273,"num_write_kb":33978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7277,"ondisk_log_size":7277,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329012,"kb_used_data":63732,"kb_used_omap":12,"kb_used_meta":265203,"kb_avail":754645708,"statfs":{"total":773094113280,"available":772757204992,"internally_reserved":0,"allocated":65261568,"data_stored":64028321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12742,"internal_metadata":271568442},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004077"},"pg_stats":[{"pgid":"3.3f","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:16.146788+0000","last_change":"2024-05-08T21:01:16.147168+0000","last_active":"2024-05-08T21:01:16.146788+0000","last_peered":"2024-05-08T21:01:16.146788+0000","last_clean":"2024-05-08T21:01:16.146788+0000","last_became_active":"2024-05-08T20:56:41.797921+0000","last_became_peered":"2024-05-08T20:56:41.797921+0000","last_unstale":"2024-05-08T21:01:16.146788+0000","last_undegraded":"2024-05-08T21:01:16.146788+0000","last_fullsized":"2024-05-08T21:01:16.146788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:01:16.146730+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:01:16.146730+0000","last_clean_scrub_stamp":"2024-05-08T21:01:16.146730+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:43:51.249653+0000","scrub_duration":0.003206637,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.615112+0000","last_change":"2024-05-08T21:00:54.615505+0000","last_active":"2024-05-08T21:00:54.615112+0000","last_peered":"2024-05-08T21:00:54.615112+0000","last_clean":"2024-05-08T21:00:54.615112+0000","last_became_active":"2024-05-08T20:56:41.797509+0000","last_became_peered":"2024-05-08T20:56:41.797509+0000","last_unstale":"2024-05-08T21:00:54.615112+0000","last_undegraded":"2024-05-08T21:00:54.615112+0000","last_fullsized":"2024-05-08T21:00:54.615112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:54.615017+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:54.615017+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.615017+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:02.733537+0000","scrub_duration":0.0035085160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:00.307478+0000","last_change":"2024-05-08T21:01:00.307787+0000","last_active":"2024-05-08T21:01:00.307478+0000","last_peered":"2024-05-08T21:01:00.307478+0000","last_clean":"2024-05-08T21:01:00.307478+0000","last_became_active":"2024-05-08T20:56:41.795176+0000","last_became_peered":"2024-05-08T20:56:41.795176+0000","last_unstale":"2024-05-08T21:01:00.307478+0000","last_undegraded":"2024-05-08T21:01:00.307478+0000","last_fullsized":"2024-05-08T21:01:00.307478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:01:00.307424+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:01:00.307424+0000","last_clean_scrub_stamp":"2024-05-08T21:01:00.307424+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:08.425945+0000","scrub_duration":0.0026575919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'40","reported_seq":66,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:07.486218+0000","last_change":"2024-05-08T21:01:07.486468+0000","last_active":"2024-05-08T21:01:07.486218+0000","last_peered":"2024-05-08T21:01:07.486218+0000","last_clean":"2024-05-08T21:01:07.486218+0000","last_became_active":"2024-05-08T20:56:41.800301+0000","last_became_peered":"2024-05-08T20:56:41.800301+0000","last_unstale":"2024-05-08T21:01:07.486218+0000","last_undegraded":"2024-05-08T21:01:07.486218+0000","last_fullsized":"2024-05-08T21:01:07.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'40","last_scrub_stamp":"2024-05-08T21:01:07.486168+0000","last_deep_scrub":"22'40","last_deep_scrub_stamp":"2024-05-08T21:01:07.486168+0000","last_clean_scrub_stamp":"2024-05-08T21:01:07.486168+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:35.884358+0000","scrub_duration":0.0037742560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:17.191936+0000","last_change":"2024-05-08T21:01:17.191936+0000","last_active":"2024-05-08T21:01:17.191936+0000","last_peered":"2024-05-08T21:01:17.191936+0000","last_clean":"2024-05-08T21:01:17.191936+0000","last_became_active":"2024-05-08T20:56:41.795478+0000","last_became_peered":"2024-05-08T20:56:41.795478+0000","last_unstale":"2024-05-08T21:01:17.191936+0000","last_undegraded":"2024-05-08T21:01:17.191936+0000","last_fullsized":"2024-05-08T21:01:17.191936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:01:17.191647+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:01:17.191647+0000","last_clean_scrub_stamp":"2024-05-08T21:01:17.191647+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:11.390264+0000","scrub_duration":0.0035349840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:08.501620+0000","last_change":"2024-05-08T21:01:08.501620+0000","last_active":"2024-05-08T21:01:08.501620+0000","last_peered":"2024-05-08T21:01:08.501620+0000","last_clean":"2024-05-08T21:01:08.501620+0000","last_became_active":"2024-05-08T20:56:41.805134+0000","last_became_peered":"2024-05-08T20:56:41.805134+0000","last_unstale":"2024-05-08T21:01:08.501620+0000","last_undegraded":"2024-05-08T21:01:08.501620+0000","last_fullsized":"2024-05-08T21:01:08.501620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:08.501247+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:08.501247+0000","last_clean_scrub_stamp":"2024-05-08T21:01:08.501247+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:44.111278+0000","scrub_duration":0.0034104869999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'54","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:07.156988+0000","last_change":"2024-05-08T21:01:07.156988+0000","last_active":"2024-05-08T21:01:07.156988+0000","last_peered":"2024-05-08T21:01:07.156988+0000","last_clean":"2024-05-08T21:01:07.156988+0000","last_became_active":"2024-05-08T20:56:41.799626+0000","last_became_peered":"2024-05-08T20:56:41.799626+0000","last_unstale":"2024-05-08T21:01:07.156988+0000","last_undegraded":"2024-05-08T21:01:07.156988+0000","last_fullsized":"2024-05-08T21:01:07.156988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:01:07.156674+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:01:07.156674+0000","last_clean_scrub_stamp":"2024-05-08T21:01:07.156674+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:48.380355+0000","scrub_duration":0.0035795990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:09.576036+0000","last_change":"2024-05-08T21:01:09.576036+0000","last_active":"2024-05-08T21:01:09.576036+0000","last_peered":"2024-05-08T21:01:09.576036+0000","last_clean":"2024-05-08T21:01:09.576036+0000","last_became_active":"2024-05-08T20:56:41.804530+0000","last_became_peered":"2024-05-08T20:56:41.804530+0000","last_unstale":"2024-05-08T21:01:09.576036+0000","last_undegraded":"2024-05-08T21:01:09.576036+0000","last_fullsized":"2024-05-08T21:01:09.576036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:09.575748+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:09.575748+0000","last_clean_scrub_stamp":"2024-05-08T21:01:09.575748+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:27.650979+0000","scrub_duration":0.0033039879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'54","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:12.192092+0000","last_change":"2024-05-08T21:01:12.192092+0000","last_active":"2024-05-08T21:01:12.192092+0000","last_peered":"2024-05-08T21:01:12.192092+0000","last_clean":"2024-05-08T21:01:12.192092+0000","last_became_active":"2024-05-08T20:56:41.804856+0000","last_became_peered":"2024-05-08T20:56:41.804856+0000","last_unstale":"2024-05-08T21:01:12.192092+0000","last_undegraded":"2024-05-08T21:01:12.192092+0000","last_fullsized":"2024-05-08T21:01:12.192092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:01:12.191775+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:01:12.191775+0000","last_clean_scrub_stamp":"2024-05-08T21:01:12.191775+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:02.877044+0000","scrub_duration":0.0033871589999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'53","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:09.280263+0000","last_change":"2024-05-08T21:01:09.280263+0000","last_active":"2024-05-08T21:01:09.280263+0000","last_peered":"2024-05-08T21:01:09.280263+0000","last_clean":"2024-05-08T21:01:09.280263+0000","last_became_active":"2024-05-08T20:56:41.805866+0000","last_became_peered":"2024-05-08T20:56:41.805866+0000","last_unstale":"2024-05-08T21:01:09.280263+0000","last_undegraded":"2024-05-08T21:01:09.280263+0000","last_fullsized":"2024-05-08T21:01:09.280263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'53","last_scrub_stamp":"2024-05-08T21:01:09.279909+0000","last_deep_scrub":"22'53","last_deep_scrub_stamp":"2024-05-08T21:01:09.279909+0000","last_clean_scrub_stamp":"2024-05-08T21:01:09.279909+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:14.295476+0000","scrub_duration":0.0030867630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'50","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.527268+0000","last_change":"2024-05-08T21:00:54.527268+0000","last_active":"2024-05-08T21:00:54.527268+0000","last_peered":"2024-05-08T21:00:54.527268+0000","last_clean":"2024-05-08T21:00:54.527268+0000","last_became_active":"2024-05-08T20:56:41.804829+0000","last_became_peered":"2024-05-08T20:56:41.804829+0000","last_unstale":"2024-05-08T21:00:54.527268+0000","last_undegraded":"2024-05-08T21:00:54.527268+0000","last_fullsized":"2024-05-08T21:00:54.527268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:54.526950+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:54.526950+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.526950+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:37.612705+0000","scrub_duration":0.0031091389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'44","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:59.679587+0000","last_change":"2024-05-08T21:00:59.679587+0000","last_active":"2024-05-08T21:00:59.679587+0000","last_peered":"2024-05-08T21:00:59.679587+0000","last_clean":"2024-05-08T21:00:59.679587+0000","last_became_active":"2024-05-08T20:56:41.807568+0000","last_became_peered":"2024-05-08T20:56:41.807568+0000","last_unstale":"2024-05-08T21:00:59.679587+0000","last_undegraded":"2024-05-08T21:00:59.679587+0000","last_fullsized":"2024-05-08T21:00:59.679587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:59.679274+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:59.679274+0000","last_clean_scrub_stamp":"2024-05-08T21:00:59.679274+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:39.106409+0000","scrub_duration":0.0032546670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.652427+0000","last_change":"2024-05-08T21:00:52.652427+0000","last_active":"2024-05-08T21:00:52.652427+0000","last_peered":"2024-05-08T21:00:52.652427+0000","last_clean":"2024-05-08T21:00:52.652427+0000","last_became_active":"2024-05-08T20:56:41.798145+0000","last_became_peered":"2024-05-08T20:56:41.798145+0000","last_unstale":"2024-05-08T21:00:52.652427+0000","last_undegraded":"2024-05-08T21:00:52.652427+0000","last_fullsized":"2024-05-08T21:00:52.652427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:00:52.652123+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:00:52.652123+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.652123+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:51.631619+0000","scrub_duration":0.0034679440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'59","reported_seq":85,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:55.272503+0000","last_change":"2024-05-08T21:00:55.272503+0000","last_active":"2024-05-08T21:00:55.272503+0000","last_peered":"2024-05-08T21:00:55.272503+0000","last_clean":"2024-05-08T21:00:55.272503+0000","last_became_active":"2024-05-08T20:56:41.788145+0000","last_became_peered":"2024-05-08T20:56:41.788145+0000","last_unstale":"2024-05-08T21:00:55.272503+0000","last_undegraded":"2024-05-08T21:00:55.272503+0000","last_fullsized":"2024-05-08T21:00:55.272503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-05-08T21:00:55.271894+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-05-08T21:00:55.271894+0000","last_clean_scrub_stamp":"2024-05-08T21:00:55.271894+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:44.230958+0000","scrub_duration":0.003210114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'53","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.552826+0000","last_change":"2024-05-08T21:00:58.552826+0000","last_active":"2024-05-08T21:00:58.552826+0000","last_peered":"2024-05-08T21:00:58.552826+0000","last_clean":"2024-05-08T21:00:58.552826+0000","last_became_active":"2024-05-08T20:56:41.810670+0000","last_became_peered":"2024-05-08T20:56:41.810670+0000","last_unstale":"2024-05-08T21:00:58.552826+0000","last_undegraded":"2024-05-08T21:00:58.552826+0000","last_fullsized":"2024-05-08T21:00:58.552826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'53","last_scrub_stamp":"2024-05-08T21:00:58.552524+0000","last_deep_scrub":"22'53","last_deep_scrub_stamp":"2024-05-08T21:00:58.552524+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.552524+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:49.267640+0000","scrub_duration":0.003437481,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'55","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:55.800675+0000","last_change":"2024-05-08T21:00:55.801006+0000","last_active":"2024-05-08T21:00:55.800675+0000","last_peered":"2024-05-08T21:00:55.800675+0000","last_clean":"2024-05-08T21:00:55.800675+0000","last_became_active":"2024-05-08T20:57:23.946946+0000","last_became_peered":"2024-05-08T20:57:23.946946+0000","last_unstale":"2024-05-08T21:00:55.800675+0000","last_undegraded":"2024-05-08T21:00:55.800675+0000","last_fullsized":"2024-05-08T21:00:55.800675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:55.800625+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:55.800625+0000","last_clean_scrub_stamp":"2024-05-08T21:00:55.800625+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:18.405211+0000","scrub_duration":0.003368303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.389267+0000","last_change":"2024-05-08T21:00:53.389267+0000","last_active":"2024-05-08T21:00:53.389267+0000","last_peered":"2024-05-08T21:00:53.389267+0000","last_clean":"2024-05-08T21:00:53.389267+0000","last_became_active":"2024-05-08T20:56:41.804787+0000","last_became_peered":"2024-05-08T20:56:41.804787+0000","last_unstale":"2024-05-08T21:00:53.389267+0000","last_undegraded":"2024-05-08T21:00:53.389267+0000","last_fullsized":"2024-05-08T21:00:53.389267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:53.388815+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:53.388815+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.388815+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:44.103931+0000","scrub_duration":0.0034609189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:54.815897+0000","last_change":"2024-05-08T21:00:54.815897+0000","last_active":"2024-05-08T21:00:54.815897+0000","last_peered":"2024-05-08T21:00:54.815897+0000","last_clean":"2024-05-08T21:00:54.815897+0000","last_became_active":"2024-05-08T20:56:41.791775+0000","last_became_peered":"2024-05-08T20:56:41.791775+0000","last_unstale":"2024-05-08T21:00:54.815897+0000","last_undegraded":"2024-05-08T21:00:54.815897+0000","last_fullsized":"2024-05-08T21:00:54.815897+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:54.815573+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:54.815573+0000","last_clean_scrub_stamp":"2024-05-08T21:00:54.815573+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:34.242708+0000","scrub_duration":0.0043193149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'51","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:06.535845+0000","last_change":"2024-05-08T21:01:06.536253+0000","last_active":"2024-05-08T21:01:06.535845+0000","last_peered":"2024-05-08T21:01:06.535845+0000","last_clean":"2024-05-08T21:01:06.535845+0000","last_became_active":"2024-05-08T20:57:23.938029+0000","last_became_peered":"2024-05-08T20:57:23.938029+0000","last_unstale":"2024-05-08T21:01:06.535845+0000","last_undegraded":"2024-05-08T21:01:06.535845+0000","last_fullsized":"2024-05-08T21:01:06.535845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:01:06.535748+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:01:06.535748+0000","last_clean_scrub_stamp":"2024-05-08T21:01:06.535748+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:24.610978+0000","scrub_duration":0.0033375499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"22'62","reported_seq":88,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.421697+0000","last_change":"2024-05-08T21:01:01.421697+0000","last_active":"2024-05-08T21:01:01.421697+0000","last_peered":"2024-05-08T21:01:01.421697+0000","last_clean":"2024-05-08T21:01:01.421697+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:01:01.421697+0000","last_undegraded":"2024-05-08T21:01:01.421697+0000","last_fullsized":"2024-05-08T21:01:01.421697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'62","last_scrub_stamp":"2024-05-08T21:01:01.421216+0000","last_deep_scrub":"22'62","last_deep_scrub_stamp":"2024-05-08T21:01:01.421216+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.421216+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:09.539737+0000","scrub_duration":0.00343881,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'63","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:08.209915+0000","last_change":"2024-05-08T21:01:08.209915+0000","last_active":"2024-05-08T21:01:08.209915+0000","last_peered":"2024-05-08T21:01:08.209915+0000","last_clean":"2024-05-08T21:01:08.209915+0000","last_became_active":"2024-05-08T20:56:41.795699+0000","last_became_peered":"2024-05-08T20:56:41.795699+0000","last_unstale":"2024-05-08T21:01:08.209915+0000","last_undegraded":"2024-05-08T21:01:08.209915+0000","last_fullsized":"2024-05-08T21:01:08.209915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'63","last_scrub_stamp":"2024-05-08T21:01:08.209418+0000","last_deep_scrub":"22'63","last_deep_scrub_stamp":"2024-05-08T21:01:08.209418+0000","last_clean_scrub_stamp":"2024-05-08T21:01:08.209418+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:11.952289+0000","scrub_duration":0.0036166739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.509968+0000","last_change":"2024-05-08T21:01:04.509968+0000","last_active":"2024-05-08T21:01:04.509968+0000","last_peered":"2024-05-08T21:01:04.509968+0000","last_clean":"2024-05-08T21:01:04.509968+0000","last_became_active":"2024-05-08T20:56:41.804572+0000","last_became_peered":"2024-05-08T20:56:41.804572+0000","last_unstale":"2024-05-08T21:01:04.509968+0000","last_undegraded":"2024-05-08T21:01:04.509968+0000","last_fullsized":"2024-05-08T21:01:04.509968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:01:04.509631+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:01:04.509631+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.509631+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:25.367581+0000","scrub_duration":0.0033214939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.636980+0000","last_change":"2024-05-08T21:00:50.636980+0000","last_active":"2024-05-08T21:00:50.636980+0000","last_peered":"2024-05-08T21:00:50.636980+0000","last_clean":"2024-05-08T21:00:50.636980+0000","last_became_active":"2024-05-08T20:56:41.810659+0000","last_became_peered":"2024-05-08T20:56:41.810659+0000","last_unstale":"2024-05-08T21:00:50.636980+0000","last_undegraded":"2024-05-08T21:00:50.636980+0000","last_fullsized":"2024-05-08T21:00:50.636980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:50.636690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:50.636690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.636690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:33.722445+0000","scrub_duration":0.0034948969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.399039+0000","last_change":"2024-05-08T21:00:41.399039+0000","last_active":"2024-05-08T21:00:41.399039+0000","last_peered":"2024-05-08T21:00:41.399039+0000","last_clean":"2024-05-08T21:00:41.399039+0000","last_became_active":"2024-05-08T20:56:41.798031+0000","last_became_peered":"2024-05-08T20:56:41.798031+0000","last_unstale":"2024-05-08T21:00:41.399039+0000","last_undegraded":"2024-05-08T21:00:41.399039+0000","last_fullsized":"2024-05-08T21:00:41.399039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:41.398563+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.398563+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:04.003149+0000","scrub_duration":0.003734036,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'42","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.655428+0000","last_change":"2024-05-08T21:00:47.655428+0000","last_active":"2024-05-08T21:00:47.655428+0000","last_peered":"2024-05-08T21:00:47.655428+0000","last_clean":"2024-05-08T21:00:47.655428+0000","last_became_active":"2024-05-08T20:56:41.806572+0000","last_became_peered":"2024-05-08T20:56:41.806572+0000","last_unstale":"2024-05-08T21:00:47.655428+0000","last_undegraded":"2024-05-08T21:00:47.655428+0000","last_fullsized":"2024-05-08T21:00:47.655428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:47.655055+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.655055+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:27.532790+0000","scrub_duration":0.0034201549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'66","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:06.337390+0000","last_change":"2024-05-08T21:01:06.337701+0000","last_active":"2024-05-08T21:01:06.337390+0000","last_peered":"2024-05-08T21:01:06.337390+0000","last_clean":"2024-05-08T21:01:06.337390+0000","last_became_active":"2024-05-08T20:56:41.796799+0000","last_became_peered":"2024-05-08T20:56:41.796799+0000","last_unstale":"2024-05-08T21:01:06.337390+0000","last_undegraded":"2024-05-08T21:01:06.337390+0000","last_fullsized":"2024-05-08T21:01:06.337390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'66","last_scrub_stamp":"2024-05-08T21:01:06.337340+0000","last_deep_scrub":"22'66","last_deep_scrub_stamp":"2024-05-08T21:01:06.337340+0000","last_clean_scrub_stamp":"2024-05-08T21:01:06.337340+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:57.052455+0000","scrub_duration":0.0032423230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'37","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.775760+0000","last_change":"2024-05-08T21:00:47.775760+0000","last_active":"2024-05-08T21:00:47.775760+0000","last_peered":"2024-05-08T21:00:47.775760+0000","last_clean":"2024-05-08T21:00:47.775760+0000","last_became_active":"2024-05-08T20:56:41.794664+0000","last_became_peered":"2024-05-08T20:56:41.794664+0000","last_unstale":"2024-05-08T21:00:47.775760+0000","last_undegraded":"2024-05-08T21:00:47.775760+0000","last_fullsized":"2024-05-08T21:00:47.775760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'37","last_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_deep_scrub":"22'37","last_deep_scrub_stamp":"2024-05-08T21:00:47.775408+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.775408+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:30.861163+0000","scrub_duration":0.0029691850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'50","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:09.552675+0000","last_change":"2024-05-08T21:01:09.552675+0000","last_active":"2024-05-08T21:01:09.552675+0000","last_peered":"2024-05-08T21:01:09.552675+0000","last_clean":"2024-05-08T21:01:09.552675+0000","last_became_active":"2024-05-08T20:57:23.944764+0000","last_became_peered":"2024-05-08T20:57:23.944764+0000","last_unstale":"2024-05-08T21:01:09.552675+0000","last_undegraded":"2024-05-08T21:01:09.552675+0000","last_fullsized":"2024-05-08T21:01:09.552675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:01:09.552351+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:01:09.552351+0000","last_clean_scrub_stamp":"2024-05-08T21:01:09.552351+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:40:50.776032+0000","scrub_duration":0.0034649300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"22'52","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.247759+0000","last_change":"2024-05-08T21:01:04.248040+0000","last_active":"2024-05-08T21:01:04.247759+0000","last_peered":"2024-05-08T21:01:04.247759+0000","last_clean":"2024-05-08T21:01:04.247759+0000","last_became_active":"2024-05-08T20:56:41.794301+0000","last_became_peered":"2024-05-08T20:56:41.794301+0000","last_unstale":"2024-05-08T21:01:04.247759+0000","last_undegraded":"2024-05-08T21:01:04.247759+0000","last_fullsized":"2024-05-08T21:01:04.247759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:01:04.247706+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:01:04.247706+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.247706+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:54.962822+0000","scrub_duration":0.0032607209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.587980+0000","last_change":"2024-05-08T21:01:01.588327+0000","last_active":"2024-05-08T21:01:01.587980+0000","last_peered":"2024-05-08T21:01:01.587980+0000","last_clean":"2024-05-08T21:01:01.587980+0000","last_became_active":"2024-05-08T20:56:41.801612+0000","last_became_peered":"2024-05-08T20:56:41.801612+0000","last_unstale":"2024-05-08T21:01:01.587980+0000","last_undegraded":"2024-05-08T21:01:01.587980+0000","last_fullsized":"2024-05-08T21:01:01.587980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:01:01.587882+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:01:01.587882+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.587882+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:19.663112+0000","scrub_duration":0.0036441059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'59","reported_seq":85,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.854869+0000","last_change":"2024-05-08T21:00:53.855107+0000","last_active":"2024-05-08T21:00:53.854869+0000","last_peered":"2024-05-08T21:00:53.854869+0000","last_clean":"2024-05-08T21:00:53.854869+0000","last_became_active":"2024-05-08T20:56:41.793496+0000","last_became_peered":"2024-05-08T20:56:41.793496+0000","last_unstale":"2024-05-08T21:00:53.854869+0000","last_undegraded":"2024-05-08T21:00:53.854869+0000","last_fullsized":"2024-05-08T21:00:53.854869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'59","last_scrub_stamp":"2024-05-08T21:00:53.854816+0000","last_deep_scrub":"22'59","last_deep_scrub_stamp":"2024-05-08T21:00:53.854816+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.854816+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:33.908539+0000","scrub_duration":0.0038818110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'69","reported_seq":95,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.447189+0000","last_change":"2024-05-08T21:00:56.447416+0000","last_active":"2024-05-08T21:00:56.447189+0000","last_peered":"2024-05-08T21:00:56.447189+0000","last_clean":"2024-05-08T21:00:56.447189+0000","last_became_active":"2024-05-08T20:56:41.798760+0000","last_became_peered":"2024-05-08T20:56:41.798760+0000","last_unstale":"2024-05-08T21:00:56.447189+0000","last_undegraded":"2024-05-08T21:00:56.447189+0000","last_fullsized":"2024-05-08T21:00:56.447189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'69","last_scrub_stamp":"2024-05-08T21:00:56.447138+0000","last_deep_scrub":"22'69","last_deep_scrub_stamp":"2024-05-08T21:00:56.447138+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.447138+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:45.406202+0000","scrub_duration":0.0035872759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'44","reported_seq":70,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.728898+0000","last_change":"2024-05-08T21:00:58.728898+0000","last_active":"2024-05-08T21:00:58.728898+0000","last_peered":"2024-05-08T21:00:58.728898+0000","last_clean":"2024-05-08T21:00:58.728898+0000","last_became_active":"2024-05-08T20:56:41.806153+0000","last_became_peered":"2024-05-08T20:56:41.806153+0000","last_unstale":"2024-05-08T21:00:58.728898+0000","last_undegraded":"2024-05-08T21:00:58.728898+0000","last_fullsized":"2024-05-08T21:00:58.728898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:58.728487+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:58.728487+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.728487+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:38.782210+0000","scrub_duration":0.0039242030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1518","reported_seq":1545,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:37.726489+0000","last_change":"2024-05-08T21:00:37.726489+0000","last_active":"2024-05-08T21:00:37.726489+0000","last_peered":"2024-05-08T21:00:37.726489+0000","last_clean":"2024-05-08T21:00:37.726489+0000","last_became_active":"2024-05-08T20:56:41.416999+0000","last_became_peered":"2024-05-08T20:56:41.416999+0000","last_unstale":"2024-05-08T21:00:37.726489+0000","last_undegraded":"2024-05-08T21:00:37.726489+0000","last_fullsized":"2024-05-08T21:00:37.726489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1518","last_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_deep_scrub":"22'1518","last_deep_scrub_stamp":"2024-05-08T21:00:37.726200+0000","last_clean_scrub_stamp":"2024-05-08T21:00:37.726200+0000","objects_scrubbed":1,"log_size":1518,"log_dups_size":0,"ondisk_log_size":1518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:02.621040+0000","scrub_duration":0.020388380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1491,"num_write_kb":4591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.412664+0000","last_change":"2024-05-08T21:00:44.412664+0000","last_active":"2024-05-08T21:00:44.412664+0000","last_peered":"2024-05-08T21:00:44.412664+0000","last_clean":"2024-05-08T21:00:44.412664+0000","last_became_active":"2024-05-08T20:56:41.810744+0000","last_became_peered":"2024-05-08T20:56:41.810744+0000","last_unstale":"2024-05-08T21:00:44.412664+0000","last_undegraded":"2024-05-08T21:00:44.412664+0000","last_fullsized":"2024-05-08T21:00:44.412664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:44.412281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.412281+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:20.132691+0000","scrub_duration":0.0034358980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'33","reported_seq":60,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.489459+0000","last_change":"2024-05-08T21:00:42.489459+0000","last_active":"2024-05-08T21:00:42.489459+0000","last_peered":"2024-05-08T21:00:42.489459+0000","last_clean":"2024-05-08T21:00:42.489459+0000","last_became_active":"2024-05-08T20:56:41.412181+0000","last_became_peered":"2024-05-08T20:56:41.412181+0000","last_unstale":"2024-05-08T21:00:42.489459+0000","last_undegraded":"2024-05-08T21:00:42.489459+0000","last_fullsized":"2024-05-08T21:00:42.489459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'33","last_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_deep_scrub":"22'33","last_deep_scrub_stamp":"2024-05-08T21:00:42.489252+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.489252+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:07.384093+0000","scrub_duration":0.014418689,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'19","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.676171+0000","last_change":"2024-05-08T21:00:34.676171+0000","last_active":"2024-05-08T21:00:34.676171+0000","last_peered":"2024-05-08T21:00:34.676171+0000","last_clean":"2024-05-08T21:00:34.676171+0000","last_became_active":"2024-05-08T20:56:41.405116+0000","last_became_peered":"2024-05-08T20:56:41.405116+0000","last_unstale":"2024-05-08T21:00:34.676171+0000","last_undegraded":"2024-05-08T21:00:34.676171+0000","last_fullsized":"2024-05-08T21:00:34.676171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:34.675671+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.675671+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:11.978147+0000","scrub_duration":0.0039060010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'65","reported_seq":91,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.581002+0000","last_change":"2024-05-08T21:01:04.581002+0000","last_active":"2024-05-08T21:01:04.581002+0000","last_peered":"2024-05-08T21:01:04.581002+0000","last_clean":"2024-05-08T21:01:04.581002+0000","last_became_active":"2024-05-08T20:56:41.800059+0000","last_became_peered":"2024-05-08T20:56:41.800059+0000","last_unstale":"2024-05-08T21:01:04.581002+0000","last_undegraded":"2024-05-08T21:01:04.581002+0000","last_fullsized":"2024-05-08T21:01:04.581002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'65","last_scrub_stamp":"2024-05-08T21:01:04.580713+0000","last_deep_scrub":"22'65","last_deep_scrub_stamp":"2024-05-08T21:01:04.580713+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.580713+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.596280+0000","scrub_duration":0.0036186040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"22'20","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.444544+0000","last_change":"2024-05-08T21:00:33.444544+0000","last_active":"2024-05-08T21:00:33.444544+0000","last_peered":"2024-05-08T21:00:33.444544+0000","last_clean":"2024-05-08T21:00:33.444544+0000","last_became_active":"2024-05-08T20:56:41.413156+0000","last_became_peered":"2024-05-08T20:56:41.413156+0000","last_unstale":"2024-05-08T21:00:33.444544+0000","last_undegraded":"2024-05-08T21:00:33.444544+0000","last_fullsized":"2024-05-08T21:00:33.444544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:33.444064+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.444064+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:58.392198+0000","scrub_duration":0.0033063799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'54","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:49.732741+0000","last_change":"2024-05-08T21:00:49.732741+0000","last_active":"2024-05-08T21:00:49.732741+0000","last_peered":"2024-05-08T21:00:49.732741+0000","last_clean":"2024-05-08T21:00:49.732741+0000","last_became_active":"2024-05-08T20:56:41.794815+0000","last_became_peered":"2024-05-08T20:56:41.794815+0000","last_unstale":"2024-05-08T21:00:49.732741+0000","last_undegraded":"2024-05-08T21:00:49.732741+0000","last_fullsized":"2024-05-08T21:00:49.732741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'54","last_scrub_stamp":"2024-05-08T21:00:49.732450+0000","last_deep_scrub":"22'54","last_deep_scrub_stamp":"2024-05-08T21:00:49.732450+0000","last_clean_scrub_stamp":"2024-05-08T21:00:49.732450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:38.691514+0000","scrub_duration":0.003222319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'23","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.583307+0000","last_change":"2024-05-08T21:00:50.583307+0000","last_active":"2024-05-08T21:00:50.583307+0000","last_peered":"2024-05-08T21:00:50.583307+0000","last_clean":"2024-05-08T21:00:50.583307+0000","last_became_active":"2024-05-08T20:56:41.408383+0000","last_became_peered":"2024-05-08T20:56:41.408383+0000","last_unstale":"2024-05-08T21:00:50.583307+0000","last_undegraded":"2024-05-08T21:00:50.583307+0000","last_fullsized":"2024-05-08T21:00:50.583307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'23","last_scrub_stamp":"2024-05-08T21:00:50.582969+0000","last_deep_scrub":"22'23","last_deep_scrub_stamp":"2024-05-08T21:00:50.582969+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.582969+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:14.784972+0000","scrub_duration":0.0030323250000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'73","reported_seq":99,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.292926+0000","last_change":"2024-05-08T21:00:44.292926+0000","last_active":"2024-05-08T21:00:44.292926+0000","last_peered":"2024-05-08T21:00:44.292926+0000","last_clean":"2024-05-08T21:00:44.292926+0000","last_became_active":"2024-05-08T20:56:41.796405+0000","last_became_peered":"2024-05-08T20:56:41.796405+0000","last_unstale":"2024-05-08T21:00:44.292926+0000","last_undegraded":"2024-05-08T21:00:44.292926+0000","last_fullsized":"2024-05-08T21:00:44.292926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'73","last_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_deep_scrub":"22'73","last_deep_scrub_stamp":"2024-05-08T21:00:44.292418+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.292418+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:33.251483+0000","scrub_duration":0.003408847,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.369186+0000","last_change":"2024-05-08T21:00:39.369186+0000","last_active":"2024-05-08T21:00:39.369186+0000","last_peered":"2024-05-08T21:00:39.369186+0000","last_clean":"2024-05-08T21:00:39.369186+0000","last_became_active":"2024-05-08T20:56:41.407283+0000","last_became_peered":"2024-05-08T20:56:41.407283+0000","last_unstale":"2024-05-08T21:00:39.369186+0000","last_undegraded":"2024-05-08T21:00:39.369186+0000","last_fullsized":"2024-05-08T21:00:39.369186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:39.368784+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.368784+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:19.422507+0000","scrub_duration":0.003438361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'50","reported_seq":76,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:51.263575+0000","last_change":"2024-05-08T21:00:51.263575+0000","last_active":"2024-05-08T21:00:51.263575+0000","last_peered":"2024-05-08T21:00:51.263575+0000","last_clean":"2024-05-08T21:00:51.263575+0000","last_became_active":"2024-05-08T20:56:41.793451+0000","last_became_peered":"2024-05-08T20:56:41.793451+0000","last_unstale":"2024-05-08T21:00:51.263575+0000","last_undegraded":"2024-05-08T21:00:51.263575+0000","last_fullsized":"2024-05-08T21:00:51.263575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:51.263228+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:51.263228+0000","last_clean_scrub_stamp":"2024-05-08T21:00:51.263228+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:30.690363+0000","scrub_duration":0.0036641400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'51","reported_seq":78,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.813637+0000","last_change":"2024-05-08T21:00:45.813637+0000","last_active":"2024-05-08T21:00:45.813637+0000","last_peered":"2024-05-08T21:00:45.813637+0000","last_clean":"2024-05-08T21:00:45.813637+0000","last_became_active":"2024-05-08T20:56:41.416539+0000","last_became_peered":"2024-05-08T20:56:41.416539+0000","last_unstale":"2024-05-08T21:00:45.813637+0000","last_undegraded":"2024-05-08T21:00:45.813637+0000","last_fullsized":"2024-05-08T21:00:45.813637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:45.813341+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.813341+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:25.240476+0000","scrub_duration":0.0080349970000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.645482+0000","last_change":"2024-05-08T21:00:47.645482+0000","last_active":"2024-05-08T21:00:47.645482+0000","last_peered":"2024-05-08T21:00:47.645482+0000","last_clean":"2024-05-08T21:00:47.645482+0000","last_became_active":"2024-05-08T20:56:41.807260+0000","last_became_peered":"2024-05-08T20:56:41.807260+0000","last_unstale":"2024-05-08T21:00:47.645482+0000","last_undegraded":"2024-05-08T21:00:47.645482+0000","last_fullsized":"2024-05-08T21:00:47.645482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:47.645171+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.645171+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:08.126340+0000","scrub_duration":0.003615516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'916","reported_seq":943,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.539407+0000","last_change":"2024-05-08T21:00:43.539407+0000","last_active":"2024-05-08T21:00:43.539407+0000","last_peered":"2024-05-08T21:00:43.539407+0000","last_clean":"2024-05-08T21:00:43.539407+0000","last_became_active":"2024-05-08T20:56:41.413543+0000","last_became_peered":"2024-05-08T20:56:41.413543+0000","last_unstale":"2024-05-08T21:00:43.539407+0000","last_undegraded":"2024-05-08T21:00:43.539407+0000","last_fullsized":"2024-05-08T21:00:43.539407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'916","last_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_deep_scrub":"22'916","last_deep_scrub_stamp":"2024-05-08T21:00:43.539080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.539080+0000","objects_scrubbed":4,"log_size":916,"log_dups_size":0,"ondisk_log_size":916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:19.259490+0000","scrub_duration":0.023469797000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":893,"num_write_kb":4394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:29.236927+0000","last_change":"2024-05-08T21:01:29.236927+0000","last_active":"2024-05-08T21:01:29.236927+0000","last_peered":"2024-05-08T21:01:29.236927+0000","last_clean":"2024-05-08T21:01:29.236927+0000","last_became_active":"2024-05-08T20:56:41.802066+0000","last_became_peered":"2024-05-08T20:56:41.802066+0000","last_unstale":"2024-05-08T21:01:29.236927+0000","last_undegraded":"2024-05-08T21:01:29.236927+0000","last_fullsized":"2024-05-08T21:01:29.236927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:01:29.236630+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:01:29.236630+0000","last_clean_scrub_stamp":"2024-05-08T21:01:29.236630+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:54.133532+0000","scrub_duration":0.003590265,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'19","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.416562+0000","last_change":"2024-05-08T21:00:38.416562+0000","last_active":"2024-05-08T21:00:38.416562+0000","last_peered":"2024-05-08T21:00:38.416562+0000","last_clean":"2024-05-08T21:00:38.416562+0000","last_became_active":"2024-05-08T20:56:41.412447+0000","last_became_peered":"2024-05-08T20:56:41.412447+0000","last_unstale":"2024-05-08T21:00:38.416562+0000","last_undegraded":"2024-05-08T21:00:38.416562+0000","last_fullsized":"2024-05-08T21:00:38.416562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-05-08T21:00:38.416185+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.416185+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:32.961167+0000","scrub_duration":0.0073912780000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.411400+0000","last_change":"2024-05-08T21:00:42.411400+0000","last_active":"2024-05-08T21:00:42.411400+0000","last_peered":"2024-05-08T21:00:42.411400+0000","last_clean":"2024-05-08T21:00:42.411400+0000","last_became_active":"2024-05-08T20:56:41.795108+0000","last_became_peered":"2024-05-08T20:56:41.795108+0000","last_unstale":"2024-05-08T21:00:42.411400+0000","last_undegraded":"2024-05-08T21:00:42.411400+0000","last_fullsized":"2024-05-08T21:00:42.411400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:42.410909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.410909+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:52.782534+0000","scrub_duration":0.0037112960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"22'35","reported_seq":62,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.350668+0000","last_change":"2024-05-08T21:00:40.350668+0000","last_active":"2024-05-08T21:00:40.350668+0000","last_peered":"2024-05-08T21:00:40.350668+0000","last_clean":"2024-05-08T21:00:40.350668+0000","last_became_active":"2024-05-08T20:56:41.412101+0000","last_became_peered":"2024-05-08T20:56:41.412101+0000","last_unstale":"2024-05-08T21:00:40.350668+0000","last_undegraded":"2024-05-08T21:00:40.350668+0000","last_fullsized":"2024-05-08T21:00:40.350668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'35","last_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_deep_scrub":"22'35","last_deep_scrub_stamp":"2024-05-08T21:00:40.350213+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.350213+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:19.777348+0000","scrub_duration":0.0036910760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'63","reported_seq":89,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:04.193646+0000","last_change":"2024-05-08T21:01:04.193646+0000","last_active":"2024-05-08T21:01:04.193646+0000","last_peered":"2024-05-08T21:01:04.193646+0000","last_clean":"2024-05-08T21:01:04.193646+0000","last_became_active":"2024-05-08T20:56:41.807963+0000","last_became_peered":"2024-05-08T20:56:41.807963+0000","last_unstale":"2024-05-08T21:01:04.193646+0000","last_undegraded":"2024-05-08T21:01:04.193646+0000","last_fullsized":"2024-05-08T21:01:04.193646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'63","last_scrub_stamp":"2024-05-08T21:01:04.193194+0000","last_deep_scrub":"22'63","last_deep_scrub_stamp":"2024-05-08T21:01:04.193194+0000","last_clean_scrub_stamp":"2024-05-08T21:01:04.193194+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:01:22.268425+0000","scrub_duration":0.003423054,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'30","reported_seq":57,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.424776+0000","last_change":"2024-05-08T21:00:40.424776+0000","last_active":"2024-05-08T21:00:40.424776+0000","last_peered":"2024-05-08T21:00:40.424776+0000","last_clean":"2024-05-08T21:00:40.424776+0000","last_became_active":"2024-05-08T20:56:41.414368+0000","last_became_peered":"2024-05-08T20:56:41.414368+0000","last_unstale":"2024-05-08T21:00:40.424776+0000","last_undegraded":"2024-05-08T21:00:40.424776+0000","last_fullsized":"2024-05-08T21:00:40.424776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'30","last_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_deep_scrub":"22'30","last_deep_scrub_stamp":"2024-05-08T21:00:40.424482+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.424482+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:18.189346+0000","scrub_duration":0.003259638,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'49","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.558765+0000","last_change":"2024-05-08T21:00:53.558765+0000","last_active":"2024-05-08T21:00:53.558765+0000","last_peered":"2024-05-08T21:00:53.558765+0000","last_clean":"2024-05-08T21:00:53.558765+0000","last_became_active":"2024-05-08T20:56:41.798407+0000","last_became_peered":"2024-05-08T20:56:41.798407+0000","last_unstale":"2024-05-08T21:00:53.558765+0000","last_undegraded":"2024-05-08T21:00:53.558765+0000","last_fullsized":"2024-05-08T21:00:53.558765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'49","last_scrub_stamp":"2024-05-08T21:00:53.558327+0000","last_deep_scrub":"22'49","last_deep_scrub_stamp":"2024-05-08T21:00:53.558327+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.558327+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:16.162913+0000","scrub_duration":0.0039466500000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'36","reported_seq":63,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.803499+0000","last_change":"2024-05-08T21:00:42.803499+0000","last_active":"2024-05-08T21:00:42.803499+0000","last_peered":"2024-05-08T21:00:42.803499+0000","last_clean":"2024-05-08T21:00:42.803499+0000","last_became_active":"2024-05-08T20:56:41.413272+0000","last_became_peered":"2024-05-08T20:56:41.413272+0000","last_unstale":"2024-05-08T21:00:42.803499+0000","last_undegraded":"2024-05-08T21:00:42.803499+0000","last_fullsized":"2024-05-08T21:00:42.803499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'36","last_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_deep_scrub":"22'36","last_deep_scrub_stamp":"2024-05-08T21:00:42.803281+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.803281+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:03.284450+0000","scrub_duration":0.013360945000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'47","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:31.918445+0000","last_change":"2024-05-08T21:00:31.918445+0000","last_active":"2024-05-08T21:00:31.918445+0000","last_peered":"2024-05-08T21:00:31.918445+0000","last_clean":"2024-05-08T21:00:31.918445+0000","last_became_active":"2024-05-08T20:56:41.810795+0000","last_became_peered":"2024-05-08T20:56:41.810795+0000","last_unstale":"2024-05-08T21:00:31.918445+0000","last_undegraded":"2024-05-08T21:00:31.918445+0000","last_fullsized":"2024-05-08T21:00:31.918445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2024-05-08T21:00:31.918115+0000","last_clean_scrub_stamp":"2024-05-08T21:00:31.918115+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:56.866249+0000","scrub_duration":0.0031224640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.691488+0000","last_change":"2024-05-08T21:00:46.691488+0000","last_active":"2024-05-08T21:00:46.691488+0000","last_peered":"2024-05-08T21:00:46.691488+0000","last_clean":"2024-05-08T21:00:46.691488+0000","last_became_active":"2024-05-08T20:56:41.420035+0000","last_became_peered":"2024-05-08T20:56:41.420035+0000","last_unstale":"2024-05-08T21:00:46.691488+0000","last_undegraded":"2024-05-08T21:00:46.691488+0000","last_fullsized":"2024-05-08T21:00:46.691488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:46.691190+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.691190+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:41.236171+0000","scrub_duration":0.007003202,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'39","reported_seq":65,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:59.232859+0000","last_change":"2024-05-08T21:00:59.232859+0000","last_active":"2024-05-08T21:00:59.232859+0000","last_peered":"2024-05-08T21:00:59.232859+0000","last_clean":"2024-05-08T21:00:59.232859+0000","last_became_active":"2024-05-08T20:56:41.807175+0000","last_became_peered":"2024-05-08T20:56:41.807175+0000","last_unstale":"2024-05-08T21:00:59.232859+0000","last_undegraded":"2024-05-08T21:00:59.232859+0000","last_fullsized":"2024-05-08T21:00:59.232859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'39","last_scrub_stamp":"2024-05-08T21:00:59.232536+0000","last_deep_scrub":"22'39","last_deep_scrub_stamp":"2024-05-08T21:00:59.232536+0000","last_clean_scrub_stamp":"2024-05-08T21:00:59.232536+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:04.248104+0000","scrub_duration":0.0030277139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:47.854245+0000","last_change":"2024-05-08T21:00:47.854245+0000","last_active":"2024-05-08T21:00:47.854245+0000","last_peered":"2024-05-08T21:00:47.854245+0000","last_clean":"2024-05-08T21:00:47.854245+0000","last_became_active":"2024-05-08T20:56:41.406102+0000","last_became_peered":"2024-05-08T20:56:41.406102+0000","last_unstale":"2024-05-08T21:00:47.854245+0000","last_undegraded":"2024-05-08T21:00:47.854245+0000","last_fullsized":"2024-05-08T21:00:47.854245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:47.853909+0000","last_clean_scrub_stamp":"2024-05-08T21:00:47.853909+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:23.574319+0000","scrub_duration":0.0059207569999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'47","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:10.149615+0000","last_change":"2024-05-08T21:01:10.149615+0000","last_active":"2024-05-08T21:01:10.149615+0000","last_peered":"2024-05-08T21:01:10.149615+0000","last_clean":"2024-05-08T21:01:10.149615+0000","last_became_active":"2024-05-08T20:56:41.807097+0000","last_became_peered":"2024-05-08T20:56:41.807097+0000","last_unstale":"2024-05-08T21:01:10.149615+0000","last_undegraded":"2024-05-08T21:01:10.149615+0000","last_fullsized":"2024-05-08T21:01:10.149615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'47","last_scrub_stamp":"2024-05-08T21:01:10.149315+0000","last_deep_scrub":"22'47","last_deep_scrub_stamp":"2024-05-08T21:01:10.149315+0000","last_clean_scrub_stamp":"2024-05-08T21:01:10.149315+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:38.547505+0000","scrub_duration":0.0031567610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'25","reported_seq":52,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:33.771270+0000","last_change":"2024-05-08T21:00:33.771270+0000","last_active":"2024-05-08T21:00:33.771270+0000","last_peered":"2024-05-08T21:00:33.771270+0000","last_clean":"2024-05-08T21:00:33.771270+0000","last_became_active":"2024-05-08T20:56:41.413215+0000","last_became_peered":"2024-05-08T20:56:41.413215+0000","last_unstale":"2024-05-08T21:00:33.771270+0000","last_undegraded":"2024-05-08T21:00:33.771270+0000","last_fullsized":"2024-05-08T21:00:33.771270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'25","last_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_deep_scrub":"22'25","last_deep_scrub_stamp":"2024-05-08T21:00:33.771004+0000","last_clean_scrub_stamp":"2024-05-08T21:00:33.771004+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:54.252173+0000","scrub_duration":0.006918853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:49.394251+0000","last_change":"2024-05-08T21:00:49.394251+0000","last_active":"2024-05-08T21:00:49.394251+0000","last_peered":"2024-05-08T21:00:49.394251+0000","last_clean":"2024-05-08T21:00:49.394251+0000","last_became_active":"2024-05-08T20:56:41.800498+0000","last_became_peered":"2024-05-08T20:56:41.800498+0000","last_unstale":"2024-05-08T21:00:49.394251+0000","last_undegraded":"2024-05-08T21:00:49.394251+0000","last_fullsized":"2024-05-08T21:00:49.394251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:49.393950+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:49.393950+0000","last_clean_scrub_stamp":"2024-05-08T21:00:49.393950+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:57.512471+0000","scrub_duration":0.0037924870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'29","reported_seq":56,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:41.796298+0000","last_change":"2024-05-08T21:00:41.796298+0000","last_active":"2024-05-08T21:00:41.796298+0000","last_peered":"2024-05-08T21:00:41.796298+0000","last_clean":"2024-05-08T21:00:41.796298+0000","last_became_active":"2024-05-08T20:56:41.407084+0000","last_became_peered":"2024-05-08T20:56:41.407084+0000","last_unstale":"2024-05-08T21:00:41.796298+0000","last_undegraded":"2024-05-08T21:00:41.796298+0000","last_fullsized":"2024-05-08T21:00:41.796298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'29","last_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_deep_scrub":"22'29","last_deep_scrub_stamp":"2024-05-08T21:00:41.795973+0000","last_clean_scrub_stamp":"2024-05-08T21:00:41.795973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:36.340955+0000","scrub_duration":0.003348916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'46","reported_seq":80,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:11.168991+0000","last_change":"2024-05-08T21:01:11.168991+0000","last_active":"2024-05-08T21:01:11.168991+0000","last_peered":"2024-05-08T21:01:11.168991+0000","last_clean":"2024-05-08T21:01:11.168991+0000","last_became_active":"2024-05-08T20:57:23.939282+0000","last_became_peered":"2024-05-08T20:57:23.939282+0000","last_unstale":"2024-05-08T21:01:11.168991+0000","last_undegraded":"2024-05-08T21:01:11.168991+0000","last_fullsized":"2024-05-08T21:01:11.168991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:01:11.168700+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:01:11.168700+0000","last_clean_scrub_stamp":"2024-05-08T21:01:11.168700+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:46.778730+0000","scrub_duration":0.0036335180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:40.002791+0000","last_change":"2024-05-08T21:00:40.003115+0000","last_active":"2024-05-08T21:00:40.002791+0000","last_peered":"2024-05-08T21:00:40.002791+0000","last_clean":"2024-05-08T21:00:40.002791+0000","last_became_active":"2024-05-08T20:56:30.267658+0000","last_became_peered":"2024-05-08T20:56:30.267658+0000","last_unstale":"2024-05-08T21:00:40.002791+0000","last_undegraded":"2024-05-08T21:00:40.002791+0000","last_fullsized":"2024-05-08T21:00:40.002791+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-05-08T21:00:40.002743+0000","last_clean_scrub_stamp":"2024-05-08T21:00:40.002743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:04.204746+0000","scrub_duration":0.010423897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'20","reported_seq":47,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:34.434755+0000","last_change":"2024-05-08T21:00:34.434755+0000","last_active":"2024-05-08T21:00:34.434755+0000","last_peered":"2024-05-08T21:00:34.434755+0000","last_clean":"2024-05-08T21:00:34.434755+0000","last_became_active":"2024-05-08T20:56:41.411426+0000","last_became_peered":"2024-05-08T20:56:41.411426+0000","last_unstale":"2024-05-08T21:00:34.434755+0000","last_undegraded":"2024-05-08T21:00:34.434755+0000","last_fullsized":"2024-05-08T21:00:34.434755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'20","last_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_deep_scrub":"22'20","last_deep_scrub_stamp":"2024-05-08T21:00:34.434434+0000","last_clean_scrub_stamp":"2024-05-08T21:00:34.434434+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:09.727644+0000","scrub_duration":0.0038574659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'57","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.754702+0000","last_change":"2024-05-08T21:00:56.754702+0000","last_active":"2024-05-08T21:00:56.754702+0000","last_peered":"2024-05-08T21:00:56.754702+0000","last_clean":"2024-05-08T21:00:56.754702+0000","last_became_active":"2024-05-08T20:57:23.936601+0000","last_became_peered":"2024-05-08T20:57:23.936601+0000","last_unstale":"2024-05-08T21:00:56.754702+0000","last_undegraded":"2024-05-08T21:00:56.754702+0000","last_fullsized":"2024-05-08T21:00:56.754702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2024-05-08T21:00:56.754402+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2024-05-08T21:00:56.754402+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.754402+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:39.840158+0000","scrub_duration":0.0039386769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.042986+0000","last_change":"2024-05-08T21:00:42.042986+0000","last_active":"2024-05-08T21:00:42.042986+0000","last_peered":"2024-05-08T21:00:42.042986+0000","last_clean":"2024-05-08T21:00:42.042986+0000","last_became_active":"2024-05-08T20:56:41.419295+0000","last_became_peered":"2024-05-08T20:56:41.419295+0000","last_unstale":"2024-05-08T21:00:42.042986+0000","last_undegraded":"2024-05-08T21:00:42.042986+0000","last_fullsized":"2024-05-08T21:00:42.042986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:42.042532+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.042532+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:21.469667+0000","scrub_duration":0.0045502980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'43","reported_seq":69,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.284423+0000","last_change":"2024-05-08T21:00:52.284423+0000","last_active":"2024-05-08T21:00:52.284423+0000","last_peered":"2024-05-08T21:00:52.284423+0000","last_clean":"2024-05-08T21:00:52.284423+0000","last_became_active":"2024-05-08T20:56:41.810729+0000","last_became_peered":"2024-05-08T20:56:41.810729+0000","last_unstale":"2024-05-08T21:00:52.284423+0000","last_undegraded":"2024-05-08T21:00:52.284423+0000","last_fullsized":"2024-05-08T21:00:52.284423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'43","last_scrub_stamp":"2024-05-08T21:00:52.284118+0000","last_deep_scrub":"22'43","last_deep_scrub_stamp":"2024-05-08T21:00:52.284118+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.284118+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:14.888704+0000","scrub_duration":0.0025655999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'74","reported_seq":145,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.858180+0000","last_change":"2024-05-08T21:00:45.858180+0000","last_active":"2024-05-08T21:00:45.858180+0000","last_peered":"2024-05-08T21:00:45.858180+0000","last_clean":"2024-05-08T21:00:45.858180+0000","last_became_active":"2024-05-08T20:56:41.406421+0000","last_became_peered":"2024-05-08T20:56:41.406421+0000","last_unstale":"2024-05-08T21:00:45.858180+0000","last_undegraded":"2024-05-08T21:00:45.858180+0000","last_fullsized":"2024-05-08T21:00:45.858180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'74","last_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_deep_scrub":"22'74","last_deep_scrub_stamp":"2024-05-08T21:00:45.857839+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.857839+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:56.229464+0000","scrub_duration":0.0081842159999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":357136,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":44,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'45","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:02.540795+0000","last_change":"2024-05-08T21:01:02.541036+0000","last_active":"2024-05-08T21:01:02.540795+0000","last_peered":"2024-05-08T21:01:02.540795+0000","last_clean":"2024-05-08T21:01:02.540795+0000","last_became_active":"2024-05-08T20:56:41.798177+0000","last_became_peered":"2024-05-08T20:56:41.798177+0000","last_unstale":"2024-05-08T21:01:02.540795+0000","last_undegraded":"2024-05-08T21:01:02.540795+0000","last_fullsized":"2024-05-08T21:01:02.540795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:01:02.540747+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:01:02.540747+0000","last_clean_scrub_stamp":"2024-05-08T21:01:02.540747+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:06.283618+0000","scrub_duration":0.0034748729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.479144+0000","last_change":"2024-05-08T21:00:32.479144+0000","last_active":"2024-05-08T21:00:32.479144+0000","last_peered":"2024-05-08T21:00:32.479144+0000","last_clean":"2024-05-08T21:00:32.479144+0000","last_became_active":"2024-05-08T20:56:41.412580+0000","last_became_peered":"2024-05-08T20:56:41.412580+0000","last_unstale":"2024-05-08T21:00:32.479144+0000","last_undegraded":"2024-05-08T21:00:32.479144+0000","last_fullsized":"2024-05-08T21:00:32.479144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-05-08T21:00:32.478860+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.478860+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:42.850485+0000","scrub_duration":0.0033808480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.699970+0000","last_change":"2024-05-08T21:00:50.699970+0000","last_active":"2024-05-08T21:00:50.699970+0000","last_peered":"2024-05-08T21:00:50.699970+0000","last_clean":"2024-05-08T21:00:50.699970+0000","last_became_active":"2024-05-08T20:56:41.806708+0000","last_became_peered":"2024-05-08T20:56:41.806708+0000","last_unstale":"2024-05-08T21:00:50.699970+0000","last_undegraded":"2024-05-08T21:00:50.699970+0000","last_fullsized":"2024-05-08T21:00:50.699970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:50.699594+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:50.699594+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.699594+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.071219+0000","scrub_duration":0.0030293310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"22'22","reported_seq":49,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:36.678387+0000","last_change":"2024-05-08T21:00:36.678387+0000","last_active":"2024-05-08T21:00:36.678387+0000","last_peered":"2024-05-08T21:00:36.678387+0000","last_clean":"2024-05-08T21:00:36.678387+0000","last_became_active":"2024-05-08T20:56:41.410540+0000","last_became_peered":"2024-05-08T20:56:41.410540+0000","last_unstale":"2024-05-08T21:00:36.678387+0000","last_undegraded":"2024-05-08T21:00:36.678387+0000","last_fullsized":"2024-05-08T21:00:36.678387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'22","last_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_deep_scrub":"22'22","last_deep_scrub_stamp":"2024-05-08T21:00:36.678044+0000","last_clean_scrub_stamp":"2024-05-08T21:00:36.678044+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:47.049669+0000","scrub_duration":0.0036330770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'46","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:42.353197+0000","last_change":"2024-05-08T21:00:42.353197+0000","last_active":"2024-05-08T21:00:42.353197+0000","last_peered":"2024-05-08T21:00:42.353197+0000","last_clean":"2024-05-08T21:00:42.353197+0000","last_became_active":"2024-05-08T20:56:41.797976+0000","last_became_peered":"2024-05-08T20:56:41.797976+0000","last_unstale":"2024-05-08T21:00:42.353197+0000","last_undegraded":"2024-05-08T21:00:42.353197+0000","last_fullsized":"2024-05-08T21:00:42.353197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:42.352656+0000","last_clean_scrub_stamp":"2024-05-08T21:00:42.352656+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:25.438411+0000","scrub_duration":0.003835003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'28","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.093337+0000","last_change":"2024-05-08T21:00:44.093337+0000","last_active":"2024-05-08T21:00:44.093337+0000","last_peered":"2024-05-08T21:00:44.093337+0000","last_clean":"2024-05-08T21:00:44.093337+0000","last_became_active":"2024-05-08T20:56:41.421041+0000","last_became_peered":"2024-05-08T20:56:41.421041+0000","last_unstale":"2024-05-08T21:00:44.093337+0000","last_undegraded":"2024-05-08T21:00:44.093337+0000","last_fullsized":"2024-05-08T21:00:44.093337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:44.092882+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.092882+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:27.178637+0000","scrub_duration":0.0040887049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'45","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.788249+0000","last_change":"2024-05-08T21:00:46.788249+0000","last_active":"2024-05-08T21:00:46.788249+0000","last_peered":"2024-05-08T21:00:46.788249+0000","last_clean":"2024-05-08T21:00:46.788249+0000","last_became_active":"2024-05-08T20:56:41.795312+0000","last_became_peered":"2024-05-08T20:56:41.795312+0000","last_unstale":"2024-05-08T21:00:46.788249+0000","last_undegraded":"2024-05-08T21:00:46.788249+0000","last_fullsized":"2024-05-08T21:00:46.788249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'45","last_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_deep_scrub":"22'45","last_deep_scrub_stamp":"2024-05-08T21:00:46.787793+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.787793+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:09.392379+0000","scrub_duration":0.0034348349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'41","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:44.788225+0000","last_change":"2024-05-08T21:00:44.788225+0000","last_active":"2024-05-08T21:00:44.788225+0000","last_peered":"2024-05-08T21:00:44.788225+0000","last_clean":"2024-05-08T21:00:44.788225+0000","last_became_active":"2024-05-08T20:56:41.408791+0000","last_became_peered":"2024-05-08T20:56:41.408791+0000","last_unstale":"2024-05-08T21:00:44.788225+0000","last_undegraded":"2024-05-08T21:00:44.788225+0000","last_fullsized":"2024-05-08T21:00:44.788225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'41","last_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_deep_scrub":"22'41","last_deep_scrub_stamp":"2024-05-08T21:00:44.787841+0000","last_clean_scrub_stamp":"2024-05-08T21:00:44.787841+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:24.841564+0000","scrub_duration":0.0082866180000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'51","reported_seq":77,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.683673+0000","last_change":"2024-05-08T21:00:39.683673+0000","last_active":"2024-05-08T21:00:39.683673+0000","last_peered":"2024-05-08T21:00:39.683673+0000","last_clean":"2024-05-08T21:00:39.683673+0000","last_became_active":"2024-05-08T20:56:41.797446+0000","last_became_peered":"2024-05-08T20:56:41.797446+0000","last_unstale":"2024-05-08T21:00:39.683673+0000","last_undegraded":"2024-05-08T21:00:39.683673+0000","last_fullsized":"2024-05-08T21:00:39.683673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'51","last_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_deep_scrub":"22'51","last_deep_scrub_stamp":"2024-05-08T21:00:39.683380+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.683380+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:14.976590+0000","scrub_duration":0.003306767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'27","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.384556+0000","last_change":"2024-05-08T21:00:39.384556+0000","last_active":"2024-05-08T21:00:39.384556+0000","last_peered":"2024-05-08T21:00:39.384556+0000","last_clean":"2024-05-08T21:00:39.384556+0000","last_became_active":"2024-05-08T20:56:41.420449+0000","last_became_peered":"2024-05-08T20:56:41.420449+0000","last_unstale":"2024-05-08T21:00:39.384556+0000","last_undegraded":"2024-05-08T21:00:39.384556+0000","last_fullsized":"2024-05-08T21:00:39.384556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'27","last_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_deep_scrub":"22'27","last_deep_scrub_stamp":"2024-05-08T21:00:39.384259+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.384259+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:16.686736+0000","scrub_duration":0.0058410570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'58","reported_seq":84,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:50.293555+0000","last_change":"2024-05-08T21:00:50.293555+0000","last_active":"2024-05-08T21:00:50.293555+0000","last_peered":"2024-05-08T21:00:50.293555+0000","last_clean":"2024-05-08T21:00:50.293555+0000","last_became_active":"2024-05-08T20:56:41.794968+0000","last_became_peered":"2024-05-08T20:56:41.794968+0000","last_unstale":"2024-05-08T21:00:50.293555+0000","last_undegraded":"2024-05-08T21:00:50.293555+0000","last_fullsized":"2024-05-08T21:00:50.293555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:50.293260+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:50.293260+0000","last_clean_scrub_stamp":"2024-05-08T21:00:50.293260+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:30.346983+0000","scrub_duration":0.0036686290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'21","reported_seq":48,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:51.139818+0000","last_change":"2024-05-08T21:00:51.139818+0000","last_active":"2024-05-08T21:00:51.139818+0000","last_peered":"2024-05-08T21:00:51.139818+0000","last_clean":"2024-05-08T21:00:51.139818+0000","last_became_active":"2024-05-08T20:56:41.420853+0000","last_became_peered":"2024-05-08T20:56:41.420853+0000","last_unstale":"2024-05-08T21:00:51.139818+0000","last_undegraded":"2024-05-08T21:00:51.139818+0000","last_fullsized":"2024-05-08T21:00:51.139818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'21","last_scrub_stamp":"2024-05-08T21:00:51.139546+0000","last_deep_scrub":"22'21","last_deep_scrub_stamp":"2024-05-08T21:00:51.139546+0000","last_clean_scrub_stamp":"2024-05-08T21:00:51.139546+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:59.258067+0000","scrub_duration":0.0035273180000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.704505+0000","last_change":"2024-05-08T21:00:52.704505+0000","last_active":"2024-05-08T21:00:52.704505+0000","last_peered":"2024-05-08T21:00:52.704505+0000","last_clean":"2024-05-08T21:00:52.704505+0000","last_became_active":"2024-05-08T20:56:41.805994+0000","last_became_peered":"2024-05-08T20:56:41.805994+0000","last_unstale":"2024-05-08T21:00:52.704505+0000","last_undegraded":"2024-05-08T21:00:52.704505+0000","last_fullsized":"2024-05-08T21:00:52.704505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:00:52.704080+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:00:52.704080+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.704080+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:28.424490+0000","scrub_duration":0.003400602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'28","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:32.719141+0000","last_change":"2024-05-08T21:00:32.719141+0000","last_active":"2024-05-08T21:00:32.719141+0000","last_peered":"2024-05-08T21:00:32.719141+0000","last_clean":"2024-05-08T21:00:32.719141+0000","last_became_active":"2024-05-08T20:56:41.410927+0000","last_became_peered":"2024-05-08T20:56:41.410927+0000","last_unstale":"2024-05-08T21:00:32.719141+0000","last_undegraded":"2024-05-08T21:00:32.719141+0000","last_fullsized":"2024-05-08T21:00:32.719141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'28","last_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_deep_scrub":"22'28","last_deep_scrub_stamp":"2024-05-08T21:00:32.718866+0000","last_clean_scrub_stamp":"2024-05-08T21:00:32.718866+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:27.263848+0000","scrub_duration":0.0035823880000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'48","reported_seq":74,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:01:01.605987+0000","last_change":"2024-05-08T21:01:01.605987+0000","last_active":"2024-05-08T21:01:01.605987+0000","last_peered":"2024-05-08T21:01:01.605987+0000","last_clean":"2024-05-08T21:01:01.605987+0000","last_became_active":"2024-05-08T20:56:41.800118+0000","last_became_peered":"2024-05-08T20:56:41.800118+0000","last_unstale":"2024-05-08T21:01:01.605987+0000","last_undegraded":"2024-05-08T21:01:01.605987+0000","last_fullsized":"2024-05-08T21:01:01.605987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'48","last_scrub_stamp":"2024-05-08T21:01:01.605708+0000","last_deep_scrub":"22'48","last_deep_scrub_stamp":"2024-05-08T21:01:01.605708+0000","last_clean_scrub_stamp":"2024-05-08T21:01:01.605708+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:52.320824+0000","scrub_duration":0.003097392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'31","reported_seq":58,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:38.673744+0000","last_change":"2024-05-08T21:00:38.673744+0000","last_active":"2024-05-08T21:00:38.673744+0000","last_peered":"2024-05-08T21:00:38.673744+0000","last_clean":"2024-05-08T21:00:38.673744+0000","last_became_active":"2024-05-08T20:56:41.416779+0000","last_became_peered":"2024-05-08T20:56:41.416779+0000","last_unstale":"2024-05-08T21:00:38.673744+0000","last_undegraded":"2024-05-08T21:00:38.673744+0000","last_fullsized":"2024-05-08T21:00:38.673744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'31","last_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_deep_scrub":"22'31","last_deep_scrub_stamp":"2024-05-08T21:00:38.673453+0000","last_clean_scrub_stamp":"2024-05-08T21:00:38.673453+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:14.393863+0000","scrub_duration":0.0031815139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'55","reported_seq":81,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:45.654995+0000","last_change":"2024-05-08T21:00:45.654995+0000","last_active":"2024-05-08T21:00:45.654995+0000","last_peered":"2024-05-08T21:00:45.654995+0000","last_clean":"2024-05-08T21:00:45.654995+0000","last_became_active":"2024-05-08T20:56:41.799790+0000","last_became_peered":"2024-05-08T20:56:41.799790+0000","last_unstale":"2024-05-08T21:00:45.654995+0000","last_undegraded":"2024-05-08T21:00:45.654995+0000","last_fullsized":"2024-05-08T21:00:45.654995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'55","last_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_deep_scrub":"22'55","last_deep_scrub_stamp":"2024-05-08T21:00:45.654690+0000","last_clean_scrub_stamp":"2024-05-08T21:00:45.654690+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:09.856693+0000","scrub_duration":0.0034274710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'520","reported_seq":547,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:43.091282+0000","last_change":"2024-05-08T21:00:43.091282+0000","last_active":"2024-05-08T21:00:43.091282+0000","last_peered":"2024-05-08T21:00:43.091282+0000","last_clean":"2024-05-08T21:00:43.091282+0000","last_became_active":"2024-05-08T20:56:41.421266+0000","last_became_peered":"2024-05-08T20:56:41.421266+0000","last_unstale":"2024-05-08T21:00:43.091282+0000","last_undegraded":"2024-05-08T21:00:43.091282+0000","last_fullsized":"2024-05-08T21:00:43.091282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'520","last_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_deep_scrub":"22'520","last_deep_scrub_stamp":"2024-05-08T21:00:43.091097+0000","last_clean_scrub_stamp":"2024-05-08T21:00:43.091097+0000","objects_scrubbed":2,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:05.695683+0000","scrub_duration":0.019677249000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'42","reported_seq":68,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:52.583671+0000","last_change":"2024-05-08T21:00:52.583671+0000","last_active":"2024-05-08T21:00:52.583671+0000","last_peered":"2024-05-08T21:00:52.583671+0000","last_clean":"2024-05-08T21:00:52.583671+0000","last_became_active":"2024-05-08T20:56:41.810799+0000","last_became_peered":"2024-05-08T20:56:41.810799+0000","last_unstale":"2024-05-08T21:00:52.583671+0000","last_undegraded":"2024-05-08T21:00:52.583671+0000","last_fullsized":"2024-05-08T21:00:52.583671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'42","last_scrub_stamp":"2024-05-08T21:00:52.583366+0000","last_deep_scrub":"22'42","last_deep_scrub_stamp":"2024-05-08T21:00:52.583366+0000","last_clean_scrub_stamp":"2024-05-08T21:00:52.583366+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:32.010501+0000","scrub_duration":0.0031708209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'58","reported_seq":92,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.480126+0000","last_change":"2024-05-08T21:00:56.480126+0000","last_active":"2024-05-08T21:00:56.480126+0000","last_peered":"2024-05-08T21:00:56.480126+0000","last_clean":"2024-05-08T21:00:56.480126+0000","last_became_active":"2024-05-08T20:57:23.945320+0000","last_became_peered":"2024-05-08T20:57:23.945320+0000","last_unstale":"2024-05-08T21:00:56.480126+0000","last_undegraded":"2024-05-08T21:00:56.480126+0000","last_fullsized":"2024-05-08T21:00:56.480126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:56.479773+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:56.479773+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.479773+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.495341+0000","scrub_duration":0.0032261310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'17","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:46.090256+0000","last_change":"2024-05-08T21:00:46.090256+0000","last_active":"2024-05-08T21:00:46.090256+0000","last_peered":"2024-05-08T21:00:46.090256+0000","last_clean":"2024-05-08T21:00:46.090256+0000","last_became_active":"2024-05-08T20:56:41.418749+0000","last_became_peered":"2024-05-08T20:56:41.418749+0000","last_unstale":"2024-05-08T21:00:46.090256+0000","last_undegraded":"2024-05-08T21:00:46.090256+0000","last_fullsized":"2024-05-08T21:00:46.090256+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'17","last_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_deep_scrub":"22'17","last_deep_scrub_stamp":"2024-05-08T21:00:46.089958+0000","last_clean_scrub_stamp":"2024-05-08T21:00:46.089958+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:35.049023+0000","scrub_duration":0.0058691460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'50","reported_seq":73,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:58.756790+0000","last_change":"2024-05-08T21:00:58.757107+0000","last_active":"2024-05-08T21:00:58.756790+0000","last_peered":"2024-05-08T21:00:58.756790+0000","last_clean":"2024-05-08T21:00:58.756790+0000","last_became_active":"2024-05-08T20:57:23.944656+0000","last_became_peered":"2024-05-08T20:57:23.944656+0000","last_unstale":"2024-05-08T21:00:58.756790+0000","last_undegraded":"2024-05-08T21:00:58.756790+0000","last_fullsized":"2024-05-08T21:00:58.756790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'50","last_scrub_stamp":"2024-05-08T21:00:58.756740+0000","last_deep_scrub":"22'50","last_deep_scrub_stamp":"2024-05-08T21:00:58.756740+0000","last_clean_scrub_stamp":"2024-05-08T21:00:58.756740+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:47.715805+0000","scrub_duration":0.0033771059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'58","reported_seq":85,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:56.228903+0000","last_change":"2024-05-08T21:00:56.228903+0000","last_active":"2024-05-08T21:00:56.228903+0000","last_peered":"2024-05-08T21:00:56.228903+0000","last_clean":"2024-05-08T21:00:56.228903+0000","last_became_active":"2024-05-08T20:56:41.422060+0000","last_became_peered":"2024-05-08T20:56:41.422060+0000","last_unstale":"2024-05-08T21:00:56.228903+0000","last_undegraded":"2024-05-08T21:00:56.228903+0000","last_fullsized":"2024-05-08T21:00:56.228903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'58","last_scrub_stamp":"2024-05-08T21:00:56.228718+0000","last_deep_scrub":"22'58","last_deep_scrub_stamp":"2024-05-08T21:00:56.228718+0000","last_clean_scrub_stamp":"2024-05-08T21:00:56.228718+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:02:46.943834+0000","scrub_duration":0.017730162000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5566444,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'57","reported_seq":83,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:53.276376+0000","last_change":"2024-05-08T21:00:53.276376+0000","last_active":"2024-05-08T21:00:53.276376+0000","last_peered":"2024-05-08T21:00:53.276376+0000","last_clean":"2024-05-08T21:00:53.276376+0000","last_became_active":"2024-05-08T20:56:41.793771+0000","last_became_peered":"2024-05-08T20:56:41.793771+0000","last_unstale":"2024-05-08T21:00:53.276376+0000","last_undegraded":"2024-05-08T21:00:53.276376+0000","last_fullsized":"2024-05-08T21:00:53.276376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'57","last_scrub_stamp":"2024-05-08T21:00:53.276033+0000","last_deep_scrub":"22'57","last_deep_scrub_stamp":"2024-05-08T21:00:53.276033+0000","last_clean_scrub_stamp":"2024-05-08T21:00:53.276033+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:36.361788+0000","scrub_duration":0.0035727010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'44","reported_seq":71,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:35.712444+0000","last_change":"2024-05-08T21:00:35.712444+0000","last_active":"2024-05-08T21:00:35.712444+0000","last_peered":"2024-05-08T21:00:35.712444+0000","last_clean":"2024-05-08T21:00:35.712444+0000","last_became_active":"2024-05-08T20:56:41.409277+0000","last_became_peered":"2024-05-08T20:56:41.409277+0000","last_unstale":"2024-05-08T21:00:35.712444+0000","last_undegraded":"2024-05-08T21:00:35.712444+0000","last_fullsized":"2024-05-08T21:00:35.712444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'44","last_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_deep_scrub":"22'44","last_deep_scrub_stamp":"2024-05-08T21:00:35.712232+0000","last_clean_scrub_stamp":"2024-05-08T21:00:35.712232+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:13.477096+0000","scrub_duration":0.017292459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'46","reported_seq":72,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:57.578188+0000","last_change":"2024-05-08T21:00:57.578418+0000","last_active":"2024-05-08T21:00:57.578188+0000","last_peered":"2024-05-08T21:00:57.578188+0000","last_clean":"2024-05-08T21:00:57.578188+0000","last_became_active":"2024-05-08T20:56:41.799185+0000","last_became_peered":"2024-05-08T20:56:41.799185+0000","last_unstale":"2024-05-08T21:00:57.578188+0000","last_undegraded":"2024-05-08T21:00:57.578188+0000","last_fullsized":"2024-05-08T21:00:57.578188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'46","last_scrub_stamp":"2024-05-08T21:00:57.578136+0000","last_deep_scrub":"22'46","last_deep_scrub_stamp":"2024-05-08T21:00:57.578136+0000","last_clean_scrub_stamp":"2024-05-08T21:00:57.578136+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:05.696657+0000","scrub_duration":0.0035239300000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'52","reported_seq":79,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-08T21:00:39.425346+0000","last_change":"2024-05-08T21:00:39.425346+0000","last_active":"2024-05-08T21:00:39.425346+0000","last_peered":"2024-05-08T21:00:39.425346+0000","last_clean":"2024-05-08T21:00:39.425346+0000","last_became_active":"2024-05-08T20:56:41.410132+0000","last_became_peered":"2024-05-08T20:56:41.410132+0000","last_unstale":"2024-05-08T21:00:39.425346+0000","last_undegraded":"2024-05-08T21:00:39.425346+0000","last_fullsized":"2024-05-08T21:00:39.425346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'52","last_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_deep_scrub":"22'52","last_deep_scrub_stamp":"2024-05-08T21:00:39.425092+0000","last_clean_scrub_stamp":"2024-05-08T21:00:39.425092+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:59.906261+0000","scrub_duration":0.020912884999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3307,"ondisk_log_size":3307,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":31090874,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":44,"num_read_kb":375,"num_write":3114,"num_write_kb":31562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":62242816,"data_stored":62181748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3851,"ondisk_log_size":3851,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45548,"kb_used_data":18532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326292,"statfs":{"total":96636764160,"available":96590123008,"internally_reserved":0,"allocated":18976768,"data_stored":18823663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.54900000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1359999999999999,"5min":1.22,"15min":1.22},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.82599999999999996,"15min":0.84299999999999997},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.98099999999999998,"5min":1.254,"15min":1.254},"last":0.65500000000000003}]},{"osd":1,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.91100000000000003,"15min":0.93500000000000005},"min":{"1min":0.59199999999999997,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":1.298,"15min":1.298},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.054,"5min":0.95399999999999996,"15min":0.99199999999999999},"min":{"1min":0.84199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3220000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90400000000000003,"15min":0.96499999999999997},"min":{"1min":0.60399999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1950000000000001,"5min":1.274,"15min":1.274},"last":1.048},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.95199999999999996,"15min":1.026},"min":{"1min":0.78500000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1120000000000001,"5min":1.399,"15min":1.399},"last":0.81100000000000005}]},{"osd":3,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.877,"15min":0.871},"min":{"1min":0.73599999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2490000000000001,"5min":1.319,"15min":1.319},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.03,"5min":0.99099999999999999,"15min":1.079},"min":{"1min":0.70899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.105}]},{"osd":4,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.89700000000000002,"15min":0.93600000000000005},"min":{"1min":0.629,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.054,"5min":1.425,"15min":1.425},"last":0.745},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.996,"15min":1.0569999999999999},"min":{"1min":0.66500000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.3799999999999999,"5min":1.397,"15min":1.397},"last":0.94799999999999995}]},{"osd":5,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0249999999999999,"15min":1.081},"min":{"1min":0.68400000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.26,"5min":1.425,"15min":1.425},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0740000000000001,"15min":1.1279999999999999},"min":{"1min":0.90600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1599999999999999,"5min":1.734,"15min":1.734},"last":0.91900000000000004}]},{"osd":6,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.113,"15min":1.165},"min":{"1min":0.95299999999999996,"5min":0.63,"15min":0.63},"max":{"1min":1.248,"5min":1.821,"15min":1.821},"last":1.014},{"interface":"front","average":{"1min":1.123,"5min":1.131,"15min":1.1870000000000001},"min":{"1min":0.95799999999999996,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.3160000000000001,"5min":1.45,"15min":1.45},"last":1}]}]},{"osd":6,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53164,"kb_used_data":13860,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94318676,"statfs":{"total":96636764160,"available":96582324224,"internally_reserved":0,"allocated":14192640,"data_stored":14039081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83399999999999996,"15min":0.91200000000000003},"min":{"1min":0.53300000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.171,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.82999999999999996,"15min":0.90800000000000003},"min":{"1min":0.504,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2110000000000001,"5min":1.343,"15min":1.343},"last":1.2090000000000001}]},{"osd":1,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89100000000000001,"15min":0.97599999999999998},"min":{"1min":0.59999999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0940000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.026},{"interface":"front","average":{"1min":1.002,"5min":0.96599999999999997,"15min":1.0169999999999999},"min":{"1min":0.67900000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2709999999999999,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":1.119}]},{"osd":2,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.83299999999999996,"15min":0.874},"min":{"1min":0.64000000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1080000000000001,"5min":1.163,"15min":1.163},"last":0.749},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.88,"15min":0.91600000000000004},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.91000000000000003}]},{"osd":3,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.91400000000000003,"15min":0.95999999999999996},"min":{"1min":0.70999999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1659999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89000000000000001,"15min":0.92000000000000004},"min":{"1min":0.56899999999999995,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1120000000000001,"5min":1.258,"15min":1.258},"last":0.94899999999999995}]},{"osd":4,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88200000000000001,"15min":0.89800000000000002},"min":{"1min":0.63700000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.198,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.98299999999999998,"15min":1.0329999999999999},"min":{"1min":0.72199999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.319,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94599999999999995,"15min":0.96399999999999997},"min":{"1min":0.71599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1699999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.054,"15min":1.0820000000000001},"min":{"1min":0.88700000000000001,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.254,"5min":1.403,"15min":1.403},"last":1.0960000000000001}]},{"osd":7,"last update":"Wed May 8 21:01:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.095,"15min":1.133},"min":{"1min":0.70799999999999996,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0740000000000001,"15min":1.1080000000000001},"min":{"1min":0.95799999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3049999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.159}]}]},{"osd":5,"up_from":13,"seq":55834574915,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":233472,"data_stored":83447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.78600000000000003,"15min":0.84699999999999998},"min":{"1min":0.52400000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.087,"5min":1.173,"15min":1.173},"last":1.048},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83199999999999996,"15min":0.82399999999999995},"min":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1879999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.88800000000000001}]},{"osd":1,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85499999999999998,"15min":0.84799999999999998},"min":{"1min":0.61199999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.119,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.83899999999999997,"15min":0.85799999999999998},"min":{"1min":0.67400000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.204,"5min":1.256,"15min":1.256},"last":1.016}]},{"osd":2,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.877,"15min":0.89500000000000002},"min":{"1min":0.68500000000000005,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.139,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.86899999999999999,"15min":0.92000000000000004},"min":{"1min":0.70099999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.141,"5min":1.401,"15min":1.401},"last":1.111}]},{"osd":3,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.621,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.125,"5min":1.256,"15min":1.256},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95799999999999996,"15min":0.96499999999999997},"min":{"1min":0.74399999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.161,"5min":1.341,"15min":1.341},"last":0.92400000000000004}]},{"osd":4,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92100000000000004,"15min":0.95299999999999996},"min":{"1min":0.63300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.1890000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.97599999999999998,"15min":0.997},"min":{"1min":0.65600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.2070000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0800000000000001}]},{"osd":6,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0169999999999999,"15min":1.048},"min":{"1min":0.67200000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1619999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.046,"5min":1.044,"15min":1.077},"min":{"1min":0.75600000000000001,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.94399999999999995}]},{"osd":7,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.0669999999999999,"15min":1.0740000000000001},"min":{"1min":0.85399999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.423,"15min":1.423},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1279999999999999,"15min":1.171},"min":{"1min":1.01,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4750000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.137}]}]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43636,"kb_used_data":8428,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94328204,"statfs":{"total":96636764160,"available":96592080896,"internally_reserved":0,"allocated":8630272,"data_stored":8472091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82899999999999996,"15min":0.83699999999999997},"min":{"1min":0.71299999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.147,"5min":1.429,"15min":1.429},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.96899999999999997,"5min":0.88500000000000001,"15min":0.92900000000000005},"min":{"1min":0.59099999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.198,"5min":1.466,"15min":1.466},"last":0.95599999999999996}]},{"osd":1,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85899999999999999,"15min":0.874},"min":{"1min":0.70099999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.292,"15min":1.292},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.89900000000000002,"15min":0.94199999999999995},"min":{"1min":0.623,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1659999999999999,"5min":1.556,"15min":1.556},"last":0.85199999999999998}]},{"osd":2,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.82599999999999996,"15min":0.88300000000000001},"min":{"1min":0.66000000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.157,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.623},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84299999999999997,"15min":0.88500000000000001},"min":{"1min":0.66200000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.024,"5min":1.264,"15min":1.264},"last":0.81699999999999995}]},{"osd":3,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.93700000000000006},"min":{"1min":0.66700000000000004,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.127,"5min":1.613,"15min":1.613},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.95299999999999996,"15min":0.997},"min":{"1min":0.75,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.129,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.871}]},{"osd":5,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89100000000000001,"15min":0.91700000000000004},"min":{"1min":0.60999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.036,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0940000000000001},"min":{"1min":0.82999999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.248,"5min":2.7480000000000002,"15min":2.7480000000000002},"last":0.77200000000000002}]},{"osd":6,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.95399999999999996,"15min":1.032},"min":{"1min":0.59999999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.272,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.97299999999999998,"15min":1.0109999999999999},"min":{"1min":0.73999999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.081,"5min":1.784,"15min":1.784},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed May 8 21:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":1.0469999999999999,"15min":1.0800000000000001},"min":{"1min":0.68700000000000006,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3819999999999999,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0840000000000001,"15min":1.1399999999999999},"min":{"1min":0.68500000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2529999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.996}]}]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52176,"kb_used_data":12872,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94319664,"statfs":{"total":96636764160,"available":96583335936,"internally_reserved":0,"allocated":13180928,"data_stored":13024077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.625,"15min":0.65900000000000003},"min":{"1min":0.46000000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.95999999999999996,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.441,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0049999999999999,"5min":1.109,"15min":1.109},"last":0.69199999999999995}]},{"osd":1,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69199999999999995,"15min":0.72399999999999998},"min":{"1min":0.51300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.87,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.56200000000000006,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.66800000000000004}]},{"osd":2,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.53000000000000003,"5min":0.308,"15min":0.308},"max":{"1min":1.1499999999999999,"5min":1.671,"15min":1.671},"last":0.62},{"interface":"front","average":{"1min":0.746,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.54800000000000004,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0589999999999999,"5min":1.302,"15min":1.302},"last":0.96799999999999997}]},{"osd":4,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.98099999999999998,"15min":1.0129999999999999},"min":{"1min":0.76600000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.071},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.026,"15min":1.048},"min":{"1min":0.83399999999999996,"5min":0.623,"15min":0.623},"max":{"1min":1.6120000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.171}]},{"osd":5,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.012,"15min":1.026},"min":{"1min":0.77600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.7070000000000001,"5min":1.994,"15min":1.994},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.028,"15min":1.0880000000000001},"min":{"1min":0.77200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":2.198,"15min":2.198},"last":0.871}]},{"osd":6,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.052,"15min":1.093},"min":{"1min":0.86499999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.097},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.083,"15min":1.1140000000000001},"min":{"1min":0.93000000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.419,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.93700000000000006}]},{"osd":7,"last update":"Wed May 8 21:01:40 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.0960000000000001,"15min":1.159},"min":{"1min":0.78600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5840000000000001,"5min":2.0920000000000001,"15min":2.0920000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.119,"15min":1.155},"min":{"1min":0.83399999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4399999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.2390000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":589824,"data_stored":440493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.60599999999999998},"min":{"1min":0.48599999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.998,"5min":1.343,"15min":1.343},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.45000000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.996},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.71899999999999997,"15min":0.747},"min":{"1min":0.46000000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.89100000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.41699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.98899999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.79300000000000004}]},{"osd":3,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.67900000000000005,"15min":0.69299999999999995},"min":{"1min":0.53300000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.089,"5min":1.26,"15min":1.26},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78100000000000003,"15min":0.77200000000000002},"min":{"1min":0.58799999999999997,"5min":0.377,"15min":0.377},"max":{"1min":0.93799999999999994,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.66800000000000004,"5min":0.496,"15min":0.496},"max":{"1min":1.135,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.96799999999999997,"15min":0.996},"min":{"1min":0.77900000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.2330000000000001,"5min":1.577,"15min":1.577},"last":0.88700000000000001}]},{"osd":5,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":1.0189999999999999},"min":{"1min":0.71799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3069999999999999,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0269999999999999,"15min":1.056},"min":{"1min":0.70499999999999996,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2290000000000001,"5min":1.8,"15min":1.8},"last":0.91300000000000003}]},{"osd":6,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.99199999999999999,"15min":1.0329999999999999},"min":{"1min":0.77200000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.284,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98599999999999999,"15min":1.0880000000000001},"min":{"1min":0.71399999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.264,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.997}]},{"osd":7,"last update":"Wed May 8 21:01:37 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.0249999999999999,"15min":1.042},"min":{"1min":0.81399999999999995,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.266,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.028,"5min":1.032,"15min":1.1279999999999999},"min":{"1min":0.73599999999999999,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.224,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":237568,"data_stored":83517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.497,"5min":0.223,"15min":0.223},"max":{"1min":0.92800000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.55300000000000005,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.94899999999999995,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.63400000000000001}]},{"osd":2,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.622,"15min":0.65800000000000003},"min":{"1min":0.48599999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.82399999999999995,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.73099999999999998,"15min":0.72299999999999998},"min":{"1min":0.625,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.89500000000000002,"5min":1.294,"15min":1.294},"last":1.0960000000000001}]},{"osd":3,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.78500000000000003,"15min":0.78900000000000003},"min":{"1min":0.68799999999999994,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0740000000000001,"5min":1.173,"15min":1.173},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.74199999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0609999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.90000000000000002,"15min":0.93200000000000005},"min":{"1min":0.76300000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1559999999999999,"5min":1.26,"15min":1.26},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.94099999999999995,"15min":1},"min":{"1min":0.76000000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.125,"5min":1.901,"15min":1.901},"last":0.88900000000000001}]},{"osd":5,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.97899999999999998,"15min":1.0740000000000001},"min":{"1min":0.73599999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.1519999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0349999999999999,"15min":1.0409999999999999},"min":{"1min":0.80100000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.325,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0109999999999999}]},{"osd":6,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0309999999999999,"15min":1.081},"min":{"1min":0.79400000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.345,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.054,"15min":1.123},"min":{"1min":0.76600000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.167,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.0529999999999999}]},{"osd":7,"last update":"Wed May 8 21:01:38 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.0780000000000001,"15min":1.091},"min":{"1min":0.75700000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.407,"5min":1.663,"15min":1.663},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.085,"15min":1.133},"min":{"1min":0.82199999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.3959999999999999,"5min":2.02,"15min":2.02},"last":1.1559999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40116,"kb_used_data":9004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94331724,"statfs":{"total":96636764160,"available":96595685376,"internally_reserved":0,"allocated":9220096,"data_stored":9061952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.47299999999999998,"5min":0.251,"15min":0.251},"max":{"1min":1.004,"5min":1.028,"15min":1.028},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.60899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.996,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.54300000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1040000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.73999999999999999,"15min":0.73699999999999999},"min":{"1min":0.623,"5min":0.307,"15min":0.307},"max":{"1min":1.0660000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68000000000000005,"15min":0.79600000000000004},"min":{"1min":0.52600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0640000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.83499999999999996,"15min":0.96399999999999997},"min":{"1min":0.59499999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.006,"5min":5.2649999999999997,"15min":5.2649999999999997},"last":0.75700000000000001}]},{"osd":4,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.92900000000000005,"15min":0.92300000000000004},"min":{"1min":0.72599999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.198,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.749,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1739999999999999,"5min":1.3,"15min":1.3},"last":0.95199999999999996}]},{"osd":5,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.71399999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.79600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.23,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.014,"15min":1},"min":{"1min":0.83699999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.2989999999999999,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.872},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0509999999999999,"15min":1.2729999999999999},"min":{"1min":0.82899999999999996,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3400000000000001,"5min":8.2110000000000003,"15min":8.2110000000000003},"last":0.92800000000000005}]},{"osd":7,"last update":"Wed May 8 21:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":0.998,"15min":1.002},"min":{"1min":0.78100000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4259999999999999,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.099},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1,"15min":1.038},"min":{"1min":0.879,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.373,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":1.069}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8389246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":357136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12951552,"data_stored":12940720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8400896,"data_stored":8388734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13963264,"data_stored":13955724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":18153472,"data_stored":18149938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T21:01:53.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T21:01:53.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 Processor -- start 2024-05-08T21:01:53.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 -- start start 2024-05-08T21:01:53.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7101578e0 0x7fa710161900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7100aed50 0x7fa7100af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100af6f0 con 0x7fa71015d730 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100b3ca0 con 0x7fa7101578e0 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa710161470 con 0x7fa7100aed50 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7101578e0 0x7fa710161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7101578e0 0x7fa710161900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45782/0 (socket says 172.21.15.107:45782) 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 -- 172.21.15.107:0/860232695 learned_addr learned my addr 172.21.15.107:0/860232695 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:53.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715620700 1 --2- 172.21.15.107:0/860232695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7100aed50 0x7fa7100af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 -- 172.21.15.107:0/860232695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7100aed50 msgr2=0x7fa7100af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:53.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 --2- 172.21.15.107:0/860232695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7100aed50 0x7fa7100af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 -- 172.21.15.107:0/860232695 >> v1:172.21.15.195:6789/0 conn(0x7fa71015d730 legacy=0x7fa71015dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 -- 172.21.15.107:0/860232695 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71015e6f0 con 0x7fa7101578e0 2024-05-08T21:01:53.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa715e21700 1 --2- 172.21.15.107:0/860232695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa710161900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009910 tx=0x7fa70c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ffd274eca71e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa714e1f700 1 -- 172.21.15.107:0/860232695 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c011830 con 0x7fa7101578e0 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa714e1f700 1 -- 172.21.15.107:0/860232695 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c011990 con 0x7fa7101578e0 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa714e1f700 1 -- 172.21.15.107:0/860232695 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c011d40 con 0x7fa7101578e0 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 -- 172.21.15.107:0/860232695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 msgr2=0x7fa710161900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.534+0000 7fa716e23700 1 --2- 172.21.15.107:0/860232695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa710161900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009910 tx=0x7fa70c009c20 comp rx=0 tx=0).stop 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- 172.21.15.107:0/860232695 shutdown_connections 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 --2- 172.21.15.107:0/860232695 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa7100aed50 0x7fa7100af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 --2- 172.21.15.107:0/860232695 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa710161900 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- 172.21.15.107:0/860232695 >> 172.21.15.107:0/860232695 conn(0x7fa7100b1b40 msgr2=0x7fa7100b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:53.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- 172.21.15.107:0/860232695 shutdown_connections 2024-05-08T21:01:53.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- 172.21.15.107:0/860232695 wait complete. 2024-05-08T21:01:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 Processor -- start 2024-05-08T21:01:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- start start 2024-05-08T21:01:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7100aed50 0x7fa71013c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa71013e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa71015d730 0x7fa7100711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71013f040 con 0x7fa7101578e0 2024-05-08T21:01:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71013f300 con 0x7fa7100aed50 2024-05-08T21:01:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa710151e30 con 0x7fa71015d730 2024-05-08T21:01:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa71013e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa71013e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45790/0 (socket says 172.21.15.107:45790) 2024-05-08T21:01:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 -- 172.21.15.107:0/1815284164 learned_addr learned my addr 172.21.15.107:0/1815284164 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715e21700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7100aed50 0x7fa71013c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716622700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa71015d730 0x7fa7100711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 -- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa71015d730 msgr2=0x7fa7100711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa71015d730 0x7fa7100711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 -- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7100aed50 msgr2=0x7fa71013c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7100aed50 0x7fa71013c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 -- 172.21.15.107:0/1815284164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70c009570 con 0x7fa7101578e0 2024-05-08T21:01:53.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa715620700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa71013e5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa70400e9d0 tx=0x7fa70400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704009720 con 0x7fa7101578e0 2024-05-08T21:01:53.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70400c850 con 0x7fa7101578e0 2024-05-08T21:01:53.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400cbc0 con 0x7fa7101578e0 2024-05-08T21:01:53.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa710152110 con 0x7fa7101578e0 2024-05-08T21:01:53.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.538+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa710150940 con 0x7fa7101578e0 2024-05-08T21:01:53.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.542+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100684b0 con 0x7fa7101578e0 2024-05-08T21:01:53.553 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.542+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa70400cd20 con 0x7fa7101578e0 2024-05-08T21:01:53.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.542+0000 7fa7027fc700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa6f4066730 0x7fa6f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.542+0000 7fa715e21700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa6f4066730 0x7fa6f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.542+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fa7040843d0 con 0x7fa7101578e0 2024-05-08T21:01:53.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.542+0000 7fa715e21700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa6f4066730 0x7fa6f4068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa70c000c00 tx=0x7fa70c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.560 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.550+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fa7040515f0 con 0x7fa7101578e0 2024-05-08T21:01:53.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.718+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fa7100b28a0 con 0x7fa7101578e0 2024-05-08T21:01:53.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.726+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa7040515f0 con 0x7fa7101578e0 2024-05-08T21:01:53.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa7027fc700 1 -- 172.21.15.107:0/1815284164 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa704054c10 con 0x7fa7101578e0 2024-05-08T21:01:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa6f4066730 msgr2=0x7fa6f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa6f4066730 0x7fa6f4068bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa70c000c00 tx=0x7fa70c008030 comp rx=0 tx=0).stop 2024-05-08T21:01:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 msgr2=0x7fa71013e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa71013e5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa70400e9d0 tx=0x7fa70400ece0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 shutdown_connections 2024-05-08T21:01:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fa6f4066730 0x7fa6f4068bf0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fa71015d730 0x7fa7100711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7101578e0 0x7fa71013e5a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 --2- 172.21.15.107:0/1815284164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7100aed50 0x7fa71013c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 >> 172.21.15.107:0/1815284164 conn(0x7fa7100b1b40 msgr2=0x7fa71015eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:53.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 shutdown_connections 2024-05-08T21:01:53.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.730+0000 7fa716e23700 1 -- 172.21.15.107:0/1815284164 wait complete. 2024-05-08T21:01:53.753 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T21:01:53.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:01:53.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.858+0000 7f1deb444700 1 Processor -- start 2024-05-08T21:01:53.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.858+0000 7f1deb444700 1 -- start start 2024-05-08T21:01:53.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1de40cf5a0 0x7f1de4165ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de40cdb10 con 0x7f1de415e5b0 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de40cddf0 con 0x7f1de415e990 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de40ce3b0 con 0x7f1de40cf5a0 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1dea442700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1de415e5b0 0x7f1de40cd250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50108/0 (socket says 172.21.15.107:50108) 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1dea442700 1 -- 172.21.15.107:0/419090471 learned_addr learned my addr 172.21.15.107:0/419090471 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deac43700 1 --2- 172.21.15.107:0/419090471 >> v2:172.21.15.195:3300/0 conn(0x7f1de40cf5a0 0x7f1de4165ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1de9440700 1 -- 172.21.15.107:0/419090471 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690406612 0 0) 0x7f1de40cdb10 con 0x7f1de415e5b0 2024-05-08T21:01:53.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1de9440700 1 -- 172.21.15.107:0/419090471 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd00035d0 con 0x7f1de415e5b0 2024-05-08T21:01:53.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deac43700 1 -- 172.21.15.107:0/419090471 >> v1:172.21.15.195:6789/0 conn(0x7f1de415e990 legacy=0x7f1de40cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deac43700 1 -- 172.21.15.107:0/419090471 >> v1:172.21.15.107:6789/0 conn(0x7f1de415e5b0 legacy=0x7f1de40cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deac43700 1 -- 172.21.15.107:0/419090471 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de40ce0d0 con 0x7f1de40cf5a0 2024-05-08T21:01:53.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deac43700 1 --2- 172.21.15.107:0/419090471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de40cf5a0 0x7f1de4165ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009d90 tx=0x7f1ddc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb58c05e321b163e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1de9440700 1 -- 172.21.15.107:0/419090471 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00e070 con 0x7f1de40cf5a0 2024-05-08T21:01:53.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1de9440700 1 -- 172.21.15.107:0/419090471 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1ddc00bb20 con 0x7f1de40cf5a0 2024-05-08T21:01:53.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1de9440700 1 -- 172.21.15.107:0/419090471 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc012430 con 0x7f1de40cf5a0 2024-05-08T21:01:53.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- 172.21.15.107:0/419090471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de40cf5a0 msgr2=0x7f1de4165ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 --2- 172.21.15.107:0/419090471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de40cf5a0 0x7f1de4165ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009d90 tx=0x7f1ddc00b330 comp rx=0 tx=0).stop 2024-05-08T21:01:53.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- 172.21.15.107:0/419090471 shutdown_connections 2024-05-08T21:01:53.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 --2- 172.21.15.107:0/419090471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de40cf5a0 0x7f1de4165ec0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- 172.21.15.107:0/419090471 >> 172.21.15.107:0/419090471 conn(0x7f1de40d0d90 msgr2=0x7f1de40d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:53.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- 172.21.15.107:0/419090471 shutdown_connections 2024-05-08T21:01:53.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.862+0000 7f1deb444700 1 -- 172.21.15.107:0/419090471 wait complete. 2024-05-08T21:01:53.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 Processor -- start 2024-05-08T21:01:53.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 -- start start 2024-05-08T21:01:53.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 0x7f1de4154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de415e5b0 0x7f1de41f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de415e990 0x7f1de41f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40c7e60 con 0x7f1de40cf5a0 2024-05-08T21:01:53.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de41f5120 con 0x7f1de415e5b0 2024-05-08T21:01:53.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40c80b0 con 0x7f1de415e990 2024-05-08T21:01:53.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 0x7f1de4154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 0x7f1de4154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45802/0 (socket says 172.21.15.107:45802) 2024-05-08T21:01:53.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 -- 172.21.15.107:0/3636769 learned_addr learned my addr 172.21.15.107:0/3636769 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:53.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deac43700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de415e990 0x7f1de41f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1de9c41700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de415e5b0 0x7f1de41f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 -- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de415e990 msgr2=0x7f1de41f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de415e990 0x7f1de41f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 -- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de415e5b0 msgr2=0x7f1de41f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:53.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de415e5b0 0x7f1de41f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:53.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 -- 172.21.15.107:0/3636769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009a70 con 0x7f1de40cf5a0 2024-05-08T21:01:53.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1dea442700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 0x7f1de4154550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1de000c730 tx=0x7f1de000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0005d90 con 0x7f1de40cf5a0 2024-05-08T21:01:53.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1de00070d0 con 0x7f1de40cf5a0 2024-05-08T21:01:53.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de40b26f0 con 0x7f1de40cf5a0 2024-05-08T21:01:53.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0007480 con 0x7f1de40cf5a0 2024-05-08T21:01:53.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.866+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de40c8670 con 0x7f1de40cf5a0 2024-05-08T21:01:53.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.870+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de404e700 con 0x7f1de40cf5a0 2024-05-08T21:01:53.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.870+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1de00075e0 con 0x7f1de40cf5a0 2024-05-08T21:01:53.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.870+0000 7f1ddaffd700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1dc8066730 0x7f1dc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:53.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.870+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f1de0083810 con 0x7f1de40cf5a0 2024-05-08T21:01:53.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.870+0000 7f1de9c41700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1dc8066730 0x7f1dc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:53.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.870+0000 7f1de9c41700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1dc8066730 0x7f1dc8068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1de40b6820 tx=0x7f1dd4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:53.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:53.878+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f1de0050980 con 0x7f1de40cf5a0 2024-05-08T21:01:54.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.086+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1de40b3120 con 0x7f1de40cf5a0 2024-05-08T21:01:54.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1ddaffd700 1 -- 172.21.15.107:0/3636769 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4737 (secure 0 0 0) 0x7f1de0053fa0 con 0x7f1de40cf5a0 2024-05-08T21:01:54.096 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:01:54.097 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:56:41.769074+0000","modified":"2024-05-08T20:56:44.783973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:01:54.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1dc8066730 msgr2=0x7f1dc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1dc8066730 0x7f1dc8068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1de40b6820 tx=0x7f1dd4009040 comp rx=0 tx=0).stop 2024-05-08T21:01:54.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 msgr2=0x7f1de4154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 0x7f1de4154550 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1de000c730 tx=0x7f1de000ca40 comp rx=0 tx=0).stop 2024-05-08T21:01:54.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 shutdown_connections 2024-05-08T21:01:54.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f1dc8066730 0x7f1dc8068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1de415e990 0x7f1de41f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1de415e5b0 0x7f1de41f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 --2- 172.21.15.107:0/3636769 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1de40cf5a0 0x7f1de4154550 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 >> 172.21.15.107:0/3636769 conn(0x7f1de40d0d90 msgr2=0x7f1de415b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:54.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 shutdown_connections 2024-05-08T21:01:54.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.090+0000 7f1deb444700 1 -- 172.21.15.107:0/3636769 wait complete. 2024-05-08T21:01:54.102 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-05-08T21:01:54.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T21:01:54.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 Processor -- start 2024-05-08T21:01:54.230 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 -- start start 2024-05-08T21:01:54.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe2e415afa0 0x7fe2e415b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe2e415b8c0 0x7fe2e415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e415eda0 con 0x7fe2e415f770 2024-05-08T21:01:54.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e415ea70 con 0x7fe2e415b8c0 2024-05-08T21:01:54.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e3fff700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e415bd40 con 0x7fe2e415afa0 2024-05-08T21:01:54.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2da7fc700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe2e415b8c0 0x7fe2e415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e37fe700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe2e415f770 0x7fe2e40b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50114/0 (socket says 172.21.15.107:50114) 2024-05-08T21:01:54.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e37fe700 1 -- 172.21.15.107:0/3679081349 learned_addr learned my addr 172.21.15.107:0/3679081349 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:54.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e2ffd700 1 --2- 172.21.15.107:0/3679081349 >> v2:172.21.15.195:3300/0 conn(0x7fe2e415afa0 0x7fe2e415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2da7fc700 1 -- 172.21.15.107:0/3679081349 >> v2:172.21.15.195:3300/0 conn(0x7fe2e415afa0 msgr2=0x7fe2e415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2da7fc700 1 --2- 172.21.15.107:0/3679081349 >> v2:172.21.15.195:3300/0 conn(0x7fe2e415afa0 0x7fe2e415b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2da7fc700 1 -- 172.21.15.107:0/3679081349 >> v1:172.21.15.107:6789/0 conn(0x7fe2e415f770 legacy=0x7fe2e40b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.222+0000 7fe2e27fc700 1 -- 172.21.15.107:0/3679081349 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671126517 0 0) 0x7fe2e415eda0 con 0x7fe2e415f770 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2da7fc700 1 -- 172.21.15.107:0/3679081349 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e415c020 con 0x7fe2e415b8c0 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2da7fc700 1 --2- 172.21.15.107:0/3679081349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e415f230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe2e404f630 tx=0x7fe2cc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fd6fad376bdd10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e27fc700 1 -- 172.21.15.107:0/3679081349 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011830 con 0x7fe2e415b8c0 2024-05-08T21:01:54.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e27fc700 1 -- 172.21.15.107:0/3679081349 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe2cc011990 con 0x7fe2e415b8c0 2024-05-08T21:01:54.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e27fc700 1 -- 172.21.15.107:0/3679081349 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011d40 con 0x7fe2e415b8c0 2024-05-08T21:01:54.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- 172.21.15.107:0/3679081349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 msgr2=0x7fe2e415f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/3679081349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e415f230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe2e404f630 tx=0x7fe2cc009b30 comp rx=0 tx=0).stop 2024-05-08T21:01:54.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- 172.21.15.107:0/3679081349 shutdown_connections 2024-05-08T21:01:54.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/3679081349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e415f230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/3679081349 >> v2:172.21.15.195:3300/0 conn(0x7fe2e415afa0 0x7fe2e415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- 172.21.15.107:0/3679081349 >> 172.21.15.107:0/3679081349 conn(0x7fe2e406c330 msgr2=0x7fe2e406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:54.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- 172.21.15.107:0/3679081349 shutdown_connections 2024-05-08T21:01:54.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- 172.21.15.107:0/3679081349 wait complete. 2024-05-08T21:01:54.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 Processor -- start 2024-05-08T21:01:54.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- start start 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2e415afa0 0x7fe2e4154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e40b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2e415f770 0x7fe2e40b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40b25a0 con 0x7fe2e415b8c0 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40b2820 con 0x7fe2e415f770 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.226+0000 7fe2e3fff700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e40b2b00 con 0x7fe2e415afa0 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e40b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e40b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45810/0 (socket says 172.21.15.107:45810) 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2e37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2e415f770 0x7fe2e40b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 -- 172.21.15.107:0/55015573 learned_addr learned my addr 172.21.15.107:0/55015573 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2e2ffd700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2e415afa0 0x7fe2e4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 -- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2e415afa0 msgr2=0x7fe2e4154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2e415afa0 0x7fe2e4154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 -- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2e415f770 msgr2=0x7fe2e40b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2e415f770 0x7fe2e40b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 -- 172.21.15.107:0/55015573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0094b0 con 0x7fe2e415b8c0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2e37fe700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2e415f770 0x7fe2e40b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2da7fc700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e40b2060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009b70 tx=0x7fe2cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc004550 con 0x7fe2e415b8c0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe2cc01f070 con 0x7fe2e415b8c0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc003900 con 0x7fe2e415b8c0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e40b2de0 con 0x7fe2e415b8c0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e40b33a0 con 0x7fe2e415b8c0 2024-05-08T21:01:54.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e40b0a80 con 0x7fe2e415b8c0 2024-05-08T21:01:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.230+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2cc003a60 con 0x7fe2e415b8c0 2024-05-08T21:01:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.234+0000 7fe2dbfff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2c4066730 0x7fe2c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.234+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7fe2cc021070 con 0x7fe2e415b8c0 2024-05-08T21:01:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.234+0000 7fe2e2ffd700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2c4066730 0x7fe2c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.234+0000 7fe2e2ffd700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2c4066730 0x7fe2c4068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009bf0 tx=0x7fe2d4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.238+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7fe2cc052e10 con 0x7fe2e415b8c0 2024-05-08T21:01:54.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.446+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2e40b2c40 con 0x7fe2e415b8c0 2024-05-08T21:01:54.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.446+0000 7fe2dbfff700 1 -- 172.21.15.107:0/55015573 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4737 (secure 0 0 0) 0x7fe2e40b2c40 con 0x7fe2e415b8c0 2024-05-08T21:01:54.454 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:01:54.454 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1781551568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1781551568},{"type":"v1","addr":"172.21.15.107:6837","nonce":1781551568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/910614580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":910614580},{"type":"v1","addr":"172.21.15.195:6835","nonce":910614580}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/1838509074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":1838509074},{"type":"v1","addr":"172.21.15.107:6835","nonce":1838509074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T20:56:41.769074+0000","modified":"2024-05-08T20:56:44.783973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.195:6833/3391825242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":3391825242},{"type":"v1","addr":"172.21.15.195:6833","nonce":3391825242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T21:01:54.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2c4066730 msgr2=0x7fe2c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2c4066730 0x7fe2c4068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009bf0 tx=0x7fe2d4009240 comp rx=0 tx=0).stop 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 msgr2=0x7fe2e40b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e40b2060 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009b70 tx=0x7fe2cc004770 comp rx=0 tx=0).stop 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 shutdown_connections 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2e415f770 0x7fe2e40b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe2e415b8c0 0x7fe2e40b2060 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fe2c4066730 0x7fe2c4068bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 --2- 172.21.15.107:0/55015573 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe2e415afa0 0x7fe2e4154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 >> 172.21.15.107:0/55015573 conn(0x7fe2e406c330 msgr2=0x7fe2e4155760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 shutdown_connections 2024-05-08T21:01:54.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.450+0000 7fe2e3fff700 1 -- 172.21.15.107:0/55015573 wait complete. 2024-05-08T21:01:54.460 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 8 2024-05-08T21:01:54.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T21:01:54.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 Processor -- start 2024-05-08T21:01:54.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 -- start start 2024-05-08T21:01:54.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7feaac0b3c20 0x7feaac1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 0x7feaac0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac158960 con 0x7feaac071e70 2024-05-08T21:01:54.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac0b1f60 con 0x7feaac0b3c20 2024-05-08T21:01:54.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feab0924700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ae990 con 0x7feaac070110 2024-05-08T21:01:54.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7feaac071e70 0x7feaac0b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50118/0 (socket says 172.21.15.107:50118) 2024-05-08T21:01:54.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 -- 172.21.15.107:0/1788131296 learned_addr learned my addr 172.21.15.107:0/1788131296 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:54.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaad9d700 1 --2- 172.21.15.107:0/1788131296 >> v2:172.21.15.195:3300/0 conn(0x7feaac0b3c20 0x7feaac1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaab59e700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 0x7feaac0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547748555 0 0) 0x7feaac158960 con 0x7feaac071e70 2024-05-08T21:01:54.586 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea940035d0 con 0x7feaac071e70 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2058869981 0 0) 0x7fea940035d0 con 0x7feaac071e70 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 msgr2=0x7feaac0705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 0x7feaac0705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 >> v2:172.21.15.195:3300/0 conn(0x7feaac0b3c20 msgr2=0x7feaac1624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 --2- 172.21.15.107:0/1788131296 >> v2:172.21.15.195:3300/0 conn(0x7feaac0b3c20 0x7feaac1624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0b2170 con 0x7feaac071e70 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2715062955 0 0) 0x7fea9c001670 con 0x7feaac071e70 2024-05-08T21:01:54.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaad9d700 1 --2- 172.21.15.107:0/1788131296 >> v2:172.21.15.195:3300/0 conn(0x7feaac0b3c20 0x7feaac1624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 >> v1:172.21.15.107:6789/0 conn(0x7feaac071e70 legacy=0x7feaac0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 0x7fea94003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7fea94004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea94004db0 0x7fea94005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0b1f60 con 0x7fea94003fa0 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ae990 con 0x7fea94004db0 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7fea94004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9400ba80 con 0x7feaac070110 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaad9d700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 0x7fea94003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 -- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 msgr2=0x7fea94003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac070110 0x7fea94003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 -- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea94004db0 msgr2=0x7fea94005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaab59e700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea94004db0 0x7fea94005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea94004db0 0x7fea94005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 -- 172.21.15.107:0/1788131296 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea940035d0 con 0x7fea94003fa0 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaab59e700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea94004db0 0x7fea94005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaaa59c700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7fea94004870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00c350 tx=0x7fea940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12687da64a80da2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00ce50 con 0x7fea94003fa0 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea9c005980 con 0x7fea94003fa0 2024-05-08T21:01:54.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.578+0000 7feaa9d9b700 1 -- 172.21.15.107:0/1788131296 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c005d50 con 0x7fea94003fa0 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/1788131296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 msgr2=0x7fea94004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 --2- 172.21.15.107:0/1788131296 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7fea94004870 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00c350 tx=0x7fea940058a0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaab59e700 1 -- 172.21.15.107:0/1788131296 reap_dead start 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/1788131296 shutdown_connections 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/1788131296 >> 172.21.15.107:0/1788131296 conn(0x7feaac06c330 msgr2=0x7feaac06c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/1788131296 shutdown_connections 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/1788131296 wait complete. 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 Processor -- start 2024-05-08T21:01:54.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- start start 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7feaac1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0b2e30 0x7feaac0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0abac0 0x7feaac0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1469f0 con 0x7fea94003fa0 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0b37d0 con 0x7feaac0abac0 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac147820 con 0x7feaac0b2e30 2024-05-08T21:01:54.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7feaac1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7feaac1464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45832/0 (socket says 172.21.15.107:45832) 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 -- 172.21.15.107:0/3665802903 learned_addr learned my addr 172.21.15.107:0/3665802903 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaab59e700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0abac0 0x7feaac0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaa59c700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0b2e30 0x7feaac0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 -- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0b2e30 msgr2=0x7feaac0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0b2e30 0x7feaac0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 -- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0abac0 msgr2=0x7feaac0abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0abac0 0x7feaac0abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 -- 172.21.15.107:0/3665802903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac146c10 con 0x7fea94003fa0 2024-05-08T21:01:54.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaa59c700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0b2e30 0x7feaac0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feaaad9d700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7feaac1464b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feaa0010c90 tx=0x7feaa0009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000e8b0 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac146ef0 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7feaa000ea10 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa000edc0 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.582+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac1474b0 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.586+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0684b0 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.586+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feaa0016460 con 0x7fea94003fa0 2024-05-08T21:01:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.586+0000 7fea937fe700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fea98066730 0x7fea98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.586+0000 7feaaa59c700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fea98066730 0x7fea98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.586+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7feaa0084f60 con 0x7fea94003fa0 2024-05-08T21:01:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.590+0000 7feaaa59c700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fea98066730 0x7fea98068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feaac0b4bc0 tx=0x7fea9c00a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.590+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7feaa00520d0 con 0x7fea94003fa0 2024-05-08T21:01:54.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.758+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaac0af2e0 con 0x7fea94003fa0 2024-05-08T21:01:54.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.762+0000 7fea937fe700 1 -- 172.21.15.107:0/3665802903 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16418 (secure 0 0 0) 0x7feaa0024090 con 0x7fea94003fa0 2024-05-08T21:01:54.769 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-08T21:01:54.769 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":22,"fsid":"1fb7fa61-19f6-46b1-9f16-722373da360d","created":"2024-05-08T20:56:16.900786+0000","modified":"2024-05-08T20:57:23.923871+0000","last_up_change":"2024-05-08T20:56:28.243252+0000","last_in_change":"2024-05-08T20:56:19.778082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:56:28.753271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:56:39.969005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:56:40.759304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ec342ef5-51b0-4a13-952a-8afadec32813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":26126},{"type":"v1","addr":"172.21.15.107:6825","nonce":26126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":26126},{"type":"v1","addr":"172.21.15.107:6827","nonce":26126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":26126},{"type":"v1","addr":"172.21.15.107:6831","nonce":26126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":26126},{"type":"v1","addr":"172.21.15.107:6829","nonce":26126}]},"public_addr":"172.21.15.107:6825/26126","cluster_addr":"172.21.15.107:6827/26126","heartbeat_back_addr":"172.21.15.107:6831/26126","heartbeat_front_addr":"172.21.15.107:6829/26126","state":["exists","up"]},{"osd":1,"uuid":"38e0c83f-826a-45e9-af25-6cdab0ac7cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":26124},{"type":"v1","addr":"172.21.15.107:6801","nonce":26124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":26124},{"type":"v1","addr":"172.21.15.107:6803","nonce":26124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":26124},{"type":"v1","addr":"172.21.15.107:6807","nonce":26124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":26124},{"type":"v1","addr":"172.21.15.107:6805","nonce":26124}]},"public_addr":"172.21.15.107:6801/26124","cluster_addr":"172.21.15.107:6803/26124","heartbeat_back_addr":"172.21.15.107:6807/26124","heartbeat_front_addr":"172.21.15.107:6805/26124","state":["exists","up"]},{"osd":2,"uuid":"8dadeacb-8bf7-4c9e-aa83-4cae89f59f6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":26127},{"type":"v1","addr":"172.21.15.107:6817","nonce":26127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":26127},{"type":"v1","addr":"172.21.15.107:6819","nonce":26127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":26127},{"type":"v1","addr":"172.21.15.107:6823","nonce":26127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":26127},{"type":"v1","addr":"172.21.15.107:6821","nonce":26127}]},"public_addr":"172.21.15.107:6817/26127","cluster_addr":"172.21.15.107:6819/26127","heartbeat_back_addr":"172.21.15.107:6823/26127","heartbeat_front_addr":"172.21.15.107:6821/26127","state":["exists","up"]},{"osd":3,"uuid":"d95ef5ce-242c-4d1c-a03a-40b3cc523dbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":26125},{"type":"v1","addr":"172.21.15.107:6809","nonce":26125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":26125},{"type":"v1","addr":"172.21.15.107:6811","nonce":26125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":26125},{"type":"v1","addr":"172.21.15.107:6815","nonce":26125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":26125},{"type":"v1","addr":"172.21.15.107:6813","nonce":26125}]},"public_addr":"172.21.15.107:6809/26125","cluster_addr":"172.21.15.107:6811/26125","heartbeat_back_addr":"172.21.15.107:6815/26125","heartbeat_front_addr":"172.21.15.107:6813/26125","state":["exists","up"]},{"osd":4,"uuid":"dfe14b6e-bdcd-4337-a710-c5a87fdde46a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":26319},{"type":"v1","addr":"172.21.15.195:6809","nonce":26319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":26319},{"type":"v1","addr":"172.21.15.195:6811","nonce":26319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":26319},{"type":"v1","addr":"172.21.15.195:6815","nonce":26319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":26319},{"type":"v1","addr":"172.21.15.195:6813","nonce":26319}]},"public_addr":"172.21.15.195:6809/26319","cluster_addr":"172.21.15.195:6811/26319","heartbeat_back_addr":"172.21.15.195:6815/26319","heartbeat_front_addr":"172.21.15.195:6813/26319","state":["exists","up"]},{"osd":5,"uuid":"a13767bb-b37f-4e64-bb67-78baed813ac8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":26317},{"type":"v1","addr":"172.21.15.195:6801","nonce":26317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":26317},{"type":"v1","addr":"172.21.15.195:6803","nonce":26317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":26317},{"type":"v1","addr":"172.21.15.195:6807","nonce":26317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":26317},{"type":"v1","addr":"172.21.15.195:6805","nonce":26317}]},"public_addr":"172.21.15.195:6801/26317","cluster_addr":"172.21.15.195:6803/26317","heartbeat_back_addr":"172.21.15.195:6807/26317","heartbeat_front_addr":"172.21.15.195:6805/26317","state":["exists","up"]},{"osd":6,"uuid":"2fdc75a4-710f-4128-88e4-5a342a60985e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":26318},{"type":"v1","addr":"172.21.15.195:6817","nonce":26318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":26318},{"type":"v1","addr":"172.21.15.195:6819","nonce":26318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":26318},{"type":"v1","addr":"172.21.15.195:6823","nonce":26318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":26318},{"type":"v1","addr":"172.21.15.195:6821","nonce":26318}]},"public_addr":"172.21.15.195:6817/26318","cluster_addr":"172.21.15.195:6819/26318","heartbeat_back_addr":"172.21.15.195:6823/26318","heartbeat_front_addr":"172.21.15.195:6821/26318","state":["exists","up"]},{"osd":7,"uuid":"5b9f62ec-84d0-4653-b754-f5458cc4abbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":26320},{"type":"v1","addr":"172.21.15.195:6825","nonce":26320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":26320},{"type":"v1","addr":"172.21.15.195:6827","nonce":26320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":26320},{"type":"v1","addr":"172.21.15.195:6831","nonce":26320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":26320},{"type":"v1","addr":"172.21.15.195:6829","nonce":26320}]},"public_addr":"172.21.15.195:6825/26320","cluster_addr":"172.21.15.195:6827/26320","heartbeat_back_addr":"172.21.15.195:6831/26320","heartbeat_front_addr":"172.21.15.195:6829/26320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.242634+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.816306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.115250+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:24.835658+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.107283+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.114781+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.257408+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:56:25.309444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.2d","mappings":[{"from":7,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fea98066730 msgr2=0x7fea98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fea98066730 0x7fea98068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feaac0b4bc0 tx=0x7fea9c00a000 comp rx=0 tx=0).stop 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 msgr2=0x7feaac1464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7feaac1464b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7feaa0010c90 tx=0x7feaa0009e00 comp rx=0 tx=0).stop 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 shutdown_connections 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feaac0abac0 0x7feaac0abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7fea98066730 0x7fea98068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7feaac0b2e30 0x7feaac0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 --2- 172.21.15.107:0/3665802903 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea94003fa0 0x7feaac1464b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 >> 172.21.15.107:0/3665802903 conn(0x7feaac06c330 msgr2=0x7feaac156060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:54.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 shutdown_connections 2024-05-08T21:01:54.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.766+0000 7feab0924700 1 -- 172.21.15.107:0/3665802903 wait complete. 2024-05-08T21:01:54.788 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T21:01:54.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 Processor -- start 2024-05-08T21:01:54.900 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 -- start start 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f80e80b2dd0 0x7f80e80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e80ad2f0 0x7f80e8163970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80af8b0 con 0x7f80e806dcc0 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80b3240 con 0x7f80e80b2dd0 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ed526700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b3490 con 0x7f80e80ad2f0 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f80e80b2dd0 0x7f80e80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f80e80b2dd0 0x7f80e80acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45838/0 (socket says 172.21.15.107:45838) 2024-05-08T21:01:54.903 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 -- 172.21.15.107:0/3420461705 learned_addr learned my addr 172.21.15.107:0/3420461705 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e7fff700 1 --1- 172.21.15.107:0/3420461705 >> v1:172.21.15.107:6789/0 conn(0x7f80e806dcc0 0x7f80e80b4530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50130/0 (socket says 172.21.15.107:50130) 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80ecd25700 1 --2- 172.21.15.107:0/3420461705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e80ad2f0 0x7f80e8163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 -- 172.21.15.107:0/3420461705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e80ad2f0 msgr2=0x7f80e8163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 --2- 172.21.15.107:0/3420461705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e80ad2f0 0x7f80e8163970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 -- 172.21.15.107:0/3420461705 >> v1:172.21.15.107:6789/0 conn(0x7f80e806dcc0 legacy=0x7f80e80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e6ffd700 1 -- 172.21.15.107:0/3420461705 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12787015 0 0) 0x7f80e80af8b0 con 0x7f80e806dcc0 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 -- 172.21.15.107:0/3420461705 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80b3770 con 0x7f80e80b2dd0 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e77fe700 1 --2- 172.21.15.107:0/3420461705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e80acdb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f80d000bbb0 tx=0x7f80d000bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f114c16dcefefd39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e6ffd700 1 -- 172.21.15.107:0/3420461705 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000dd90 con 0x7f80e80b2dd0 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e6ffd700 1 -- 172.21.15.107:0/3420461705 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f80d0010470 con 0x7f80e80b2dd0 2024-05-08T21:01:54.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.894+0000 7f80e6ffd700 1 -- 172.21.15.107:0/3420461705 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0010840 con 0x7f80e80b2dd0 2024-05-08T21:01:54.905 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- 172.21.15.107:0/3420461705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 msgr2=0x7f80e80acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 --2- 172.21.15.107:0/3420461705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e80acdb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f80d000bbb0 tx=0x7f80d000bec0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- 172.21.15.107:0/3420461705 shutdown_connections 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 --2- 172.21.15.107:0/3420461705 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e80ad2f0 0x7f80e8163970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 --2- 172.21.15.107:0/3420461705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e80acdb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- 172.21.15.107:0/3420461705 >> 172.21.15.107:0/3420461705 conn(0x7f80e806b470 msgr2=0x7f80e806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- 172.21.15.107:0/3420461705 shutdown_connections 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- 172.21.15.107:0/3420461705 wait complete. 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 Processor -- start 2024-05-08T21:01:54.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- start start 2024-05-08T21:01:54.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e806dcc0 0x7f80e815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80e80ad2f0 0x7f80e8158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e8158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81545a0 con 0x7f80e80b2dd0 2024-05-08T21:01:54.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8154880 con 0x7f80e80ad2f0 2024-05-08T21:01:54.909 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ed526700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8154b60 con 0x7f80e806dcc0 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.898+0000 7f80ecd25700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e8158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e8158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45840/0 (socket says 172.21.15.107:45840) 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 -- 172.21.15.107:0/752991852 learned_addr learned my addr 172.21.15.107:0/752991852 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80e7fff700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e806dcc0 0x7f80e815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80e77fe700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80e80ad2f0 0x7f80e8158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 -- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e806dcc0 msgr2=0x7f80e815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e806dcc0 0x7f80e815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 -- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80e80ad2f0 msgr2=0x7f80e8158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80e80ad2f0 0x7f80e8158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 -- 172.21.15.107:0/752991852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d000b810 con 0x7f80e80b2dd0 2024-05-08T21:01:54.910 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ecd25700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e8158ff0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f80e000e810 tx=0x7f80e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000c070 con 0x7f80e80b2dd0 2024-05-08T21:01:54.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f80e0013650 con 0x7f80e80b2dd0 2024-05-08T21:01:54.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e8154e40 con 0x7f80e80b2dd0 2024-05-08T21:01:54.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0013a20 con 0x7f80e80b2dd0 2024-05-08T21:01:54.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e815d150 con 0x7f80e80b2dd0 2024-05-08T21:01:54.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.902+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e80684b0 con 0x7f80e80b2dd0 2024-05-08T21:01:54.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.906+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80e0013b80 con 0x7f80e80b2dd0 2024-05-08T21:01:54.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.906+0000 7f80e4ff9700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f80c8066760 0x7f80c8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:54.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.906+0000 7f80e7fff700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f80c8066760 0x7f80c8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:54.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.906+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5912+0+0 (secure 0 0 0) 0x7f80e0083d50 con 0x7f80e80b2dd0 2024-05-08T21:01:54.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.906+0000 7f80e7fff700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f80c8066760 0x7f80c8068c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f80d80012e0 tx=0x7f80d8001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:54.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:54.914+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f80e0050ec0 con 0x7f80e80b2dd0 2024-05-08T21:01:55.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.118+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f80e80cf390 con 0x7f80e80b2dd0 2024-05-08T21:01:55.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.130+0000 7f80e4ff9700 1 -- 172.21.15.107:0/752991852 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f80e00544e0 con 0x7f80e80b2dd0 2024-05-08T21:01:55.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f80c8066760 msgr2=0x7f80c8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:55.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f80c8066760 0x7f80c8068c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f80d80012e0 tx=0x7f80d8001aa0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 msgr2=0x7f80e8158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e8158ff0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f80e000e810 tx=0x7f80e000eb20 comp rx=0 tx=0).stop 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 shutdown_connections 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f80e80b2dd0 0x7f80e8158ff0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f80e80ad2f0 0x7f80e8158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f80c8066760 0x7f80c8068c20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 --2- 172.21.15.107:0/752991852 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f80e806dcc0 0x7f80e815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 >> 172.21.15.107:0/752991852 conn(0x7f80e806b470 msgr2=0x7f80e806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 shutdown_connections 2024-05-08T21:01:55.142 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.134+0000 7f80ed526700 1 -- 172.21.15.107:0/752991852 wait complete. 2024-05-08T21:01:55.143 INFO:teuthology.orchestra.run.smithi107.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T21:01:55.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T21:01:55.186 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-05-08T21:01:55.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.262+0000 7f9cb9b41700 1 Processor -- start 2024-05-08T21:01:55.272 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9b41700 1 -- start start 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9b41700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f9cb406a780 0x7f9cb406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9b41700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9cb406c5c0 0x7f9cb406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9b41700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb4161c20 con 0x7f9cb41462b0 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9b41700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb406b0e0 con 0x7f9cb406c5c0 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9b41700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb4161010 con 0x7f9cb406a780 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb8b3f700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f9cb41462b0 0x7f9cb40b3c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50138/0 (socket says 172.21.15.107:50138) 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb8b3f700 1 -- 172.21.15.107:0/1408264815 learned_addr learned my addr 172.21.15.107:0/1408264815 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9340700 1 --2- 172.21.15.107:0/1408264815 >> v2:172.21.15.107:3300/0 conn(0x7f9cb406c5c0 0x7f9cb406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb3fff700 1 --2- 172.21.15.107:0/1408264815 >> v2:172.21.15.195:3300/0 conn(0x7f9cb406a780 0x7f9cb406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb37fe700 1 -- 172.21.15.107:0/1408264815 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134284950 0 0) 0x7f9cb4161c20 con 0x7f9cb41462b0 2024-05-08T21:01:55.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb37fe700 1 -- 172.21.15.107:0/1408264815 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c9c0035d0 con 0x7f9cb41462b0 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb37fe700 1 -- 172.21.15.107:0/1408264815 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447389810 0 0) 0x7f9c9c0035d0 con 0x7f9cb41462b0 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb3fff700 1 -- 172.21.15.107:0/1408264815 >> v2:172.21.15.107:3300/0 conn(0x7f9cb406c5c0 msgr2=0x7f9cb406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb3fff700 1 --2- 172.21.15.107:0/1408264815 >> v2:172.21.15.107:3300/0 conn(0x7f9cb406c5c0 0x7f9cb406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb3fff700 1 -- 172.21.15.107:0/1408264815 >> v1:172.21.15.107:6789/0 conn(0x7f9cb41462b0 legacy=0x7f9cb40b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb3fff700 1 -- 172.21.15.107:0/1408264815 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb41612f0 con 0x7f9cb406a780 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb9340700 1 --2- 172.21.15.107:0/1408264815 >> v2:172.21.15.107:3300/0 conn(0x7f9cb406c5c0 0x7f9cb406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T21:01:55.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb3fff700 1 --2- 172.21.15.107:0/1408264815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb406a780 0x7f9cb406aba0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cb406ff70 tx=0x7f9ca400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113f9b2708c8219e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:55.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb37fe700 1 -- 172.21.15.107:0/1408264815 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400e070 con 0x7f9cb406a780 2024-05-08T21:01:55.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb37fe700 1 -- 172.21.15.107:0/1408264815 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9ca4003a40 con 0x7f9cb406a780 2024-05-08T21:01:55.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.266+0000 7f9cb37fe700 1 -- 172.21.15.107:0/1408264815 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8001670 con 0x7f9cb406a780 2024-05-08T21:01:55.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 -- 172.21.15.107:0/1408264815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb406a780 msgr2=0x7f9cb406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/1408264815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb406a780 0x7f9cb406aba0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9cb406ff70 tx=0x7f9ca400b330 comp rx=0 tx=0).stop 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 -- 172.21.15.107:0/1408264815 shutdown_connections 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/1408264815 >> v2:172.21.15.107:3300/0 conn(0x7f9cb406c5c0 0x7f9cb406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/1408264815 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb406a780 0x7f9cb406aba0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 -- 172.21.15.107:0/1408264815 >> 172.21.15.107:0/1408264815 conn(0x7f9cb40b0e00 msgr2=0x7f9cb40b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 -- 172.21.15.107:0/1408264815 shutdown_connections 2024-05-08T21:01:55.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 -- 172.21.15.107:0/1408264815 wait complete. 2024-05-08T21:01:55.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 Processor -- start 2024-05-08T21:01:55.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.270+0000 7f9cb9b41700 1 -- start start 2024-05-08T21:01:55.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 0x7f9cb415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:55.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cb406c5c0 0x7f9cb4140a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:55.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb41462b0 0x7f9cb4140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:55.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb415cac0 con 0x7f9cb406a780 2024-05-08T21:01:55.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb41f6d80 con 0x7f9cb41462b0 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb415ee80 con 0x7f9cb406c5c0 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 0x7f9cb415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 0x7f9cb415c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45856/0 (socket says 172.21.15.107:45856) 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 -- 172.21.15.107:0/3737420266 learned_addr learned my addr 172.21.15.107:0/3737420266 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9340700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb41462b0 0x7f9cb4140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb3fff700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cb406c5c0 0x7f9cb4140a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 -- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cb406c5c0 msgr2=0x7f9cb4140a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cb406c5c0 0x7f9cb4140a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 -- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb41462b0 msgr2=0x7f9cb4140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb41462b0 0x7f9cb4140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 -- 172.21.15.107:0/3737420266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac0094b0 con 0x7f9cb406a780 2024-05-08T21:01:55.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb8b3f700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 0x7f9cb415c580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80011e0 tx=0x7f9ca800ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:55.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8004ca0 con 0x7f9cb406a780 2024-05-08T21:01:55.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9ca8004e00 con 0x7f9cb406a780 2024-05-08T21:01:55.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8007310 con 0x7f9cb406a780 2024-05-08T21:01:55.282 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca4009a70 con 0x7f9cb406a780 2024-05-08T21:01:55.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb415f440 con 0x7f9cb406a780 2024-05-08T21:01:55.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.274+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb40677c0 con 0x7f9cb406a780 2024-05-08T21:01:55.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.278+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ca8007470 con 0x7f9cb406a780 2024-05-08T21:01:55.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.278+0000 7f9cb17fa700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9ca0066730 0x7f9ca0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:55.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.278+0000 7f9cb3fff700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9ca0066730 0x7f9ca0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:55.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.278+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5998+0+0 (secure 0 0 0) 0x7f9ca8083ff0 con 0x7f9cb406a780 2024-05-08T21:01:55.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.278+0000 7f9cb3fff700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9ca0066730 0x7f9ca0068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4000f80 tx=0x7f9ca4011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:55.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.286+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f9ca8051170 con 0x7f9cb406a780 2024-05-08T21:01:55.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:55.490+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9cb40684b0 con 0x7f9cb406a780 2024-05-08T21:01:56.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.134+0000 7f9cb17fa700 1 -- 172.21.15.107:0/3737420266 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ca8007720 con 0x7f9cb406a780 2024-05-08T21:01:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9ca0066730 msgr2=0x7f9ca0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:56.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9ca0066730 0x7f9ca0068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4000f80 tx=0x7f9ca4011000 comp rx=0 tx=0).stop 2024-05-08T21:01:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 msgr2=0x7f9cb415c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 0x7f9cb415c580 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80011e0 tx=0x7f9ca800ca50 comp rx=0 tx=0).stop 2024-05-08T21:01:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 shutdown_connections 2024-05-08T21:01:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9cb41462b0 0x7f9cb4140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f9ca0066730 0x7f9ca0068bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9cb406c5c0 0x7f9cb4140a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 --2- 172.21.15.107:0/3737420266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9cb406a780 0x7f9cb415c580 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 >> 172.21.15.107:0/3737420266 conn(0x7f9cb40b0e00 msgr2=0x7f9cb40b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 shutdown_connections 2024-05-08T21:01:56.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.142+0000 7f9cb9b41700 1 -- 172.21.15.107:0/3737420266 wait complete. 2024-05-08T21:01:56.167 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T21:01:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 Processor -- start 2024-05-08T21:01:56.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 -- start start 2024-05-08T21:01:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f68e80d0c30 0x7f68e80d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d02b0 0x7f68e80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:56.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e80b3030 con 0x7f68e815d300 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e80d1210 con 0x7f68e80d0c30 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ee003700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80b29e0 con 0x7f68e80d02b0 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ed001700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f68e815d300 0x7f68e80d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:50152/0 (socket says 172.21.15.107:50152) 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ed001700 1 -- 172.21.15.107:0/2740445581 learned_addr learned my addr 172.21.15.107:0/2740445581 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ed802700 1 --2- 172.21.15.107:0/2740445581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d02b0 0x7f68e80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68ec800700 1 --2- 172.21.15.107:0/2740445581 >> v2:172.21.15.195:3300/0 conn(0x7f68e80d0c30 0x7f68e80d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68dffff700 1 -- 172.21.15.107:0/2740445581 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607350861 0 0) 0x7f68e80b3030 con 0x7f68e815d300 2024-05-08T21:01:56.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.286+0000 7f68dffff700 1 -- 172.21.15.107:0/2740445581 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d40035d0 con 0x7f68e815d300 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ed802700 1 -- 172.21.15.107:0/2740445581 >> v2:172.21.15.195:3300/0 conn(0x7f68e80d0c30 msgr2=0x7f68e80d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ed802700 1 --2- 172.21.15.107:0/2740445581 >> v2:172.21.15.195:3300/0 conn(0x7f68e80d0c30 0x7f68e80d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ed802700 1 -- 172.21.15.107:0/2740445581 >> v1:172.21.15.107:6789/0 conn(0x7f68e815d300 legacy=0x7f68e80d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ed802700 1 -- 172.21.15.107:0/2740445581 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e80b2cc0 con 0x7f68e80d02b0 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ed802700 1 --2- 172.21.15.107:0/2740445581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d02b0 0x7f68e80b34c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009d90 tx=0x7f68e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e62d9389dbfd33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68dffff700 1 -- 172.21.15.107:0/2740445581 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e000e070 con 0x7f68e80d02b0 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68dffff700 1 -- 172.21.15.107:0/2740445581 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68e000bb20 con 0x7f68e80d02b0 2024-05-08T21:01:56.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68dffff700 1 -- 172.21.15.107:0/2740445581 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0012430 con 0x7f68e80d02b0 2024-05-08T21:01:56.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 -- 172.21.15.107:0/2740445581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d02b0 msgr2=0x7f68e80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:56.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 --2- 172.21.15.107:0/2740445581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d02b0 0x7f68e80b34c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009d90 tx=0x7f68e000b330 comp rx=0 tx=0).stop 2024-05-08T21:01:56.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 -- 172.21.15.107:0/2740445581 shutdown_connections 2024-05-08T21:01:56.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 --2- 172.21.15.107:0/2740445581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d02b0 0x7f68e80b34c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 --2- 172.21.15.107:0/2740445581 >> v2:172.21.15.195:3300/0 conn(0x7f68e80d0c30 0x7f68e80d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 -- 172.21.15.107:0/2740445581 >> 172.21.15.107:0/2740445581 conn(0x7f68e809c3b0 msgr2=0x7f68e80d3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 -- 172.21.15.107:0/2740445581 shutdown_connections 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 -- 172.21.15.107:0/2740445581 wait complete. 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.290+0000 7f68ee003700 1 Processor -- start 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 -- start start 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 0x7f68e80b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:56.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d0c30 0x7f68e814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68e815d300 0x7f68e814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e814a560 con 0x7f68e80d02b0 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e80b7320 con 0x7f68e815d300 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e815dcb0 con 0x7f68e80d0c30 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 0x7f68e80b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 0x7f68e80b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45866/0 (socket says 172.21.15.107:45866) 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 -- 172.21.15.107:0/3555863762 learned_addr learned my addr 172.21.15.107:0/3555863762 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:56.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ec800700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d0c30 0x7f68e814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed802700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68e815d300 0x7f68e814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 -- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d0c30 msgr2=0x7f68e814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d0c30 0x7f68e814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 -- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68e815d300 msgr2=0x7f68e814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68e815d300 0x7f68e814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 -- 172.21.15.107:0/3555863762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0009a70 con 0x7f68e80d02b0 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ed001700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 0x7f68e80b77b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c4d0 tx=0x7f68d800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:56.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8005d90 con 0x7f68e80d02b0 2024-05-08T21:01:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f68d80070d0 con 0x7f68e80d02b0 2024-05-08T21:01:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d8007460 con 0x7f68e80d02b0 2024-05-08T21:01:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e80b6cd0 con 0x7f68e80d02b0 2024-05-08T21:01:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.294+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e815df90 con 0x7f68e80d02b0 2024-05-08T21:01:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.298+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e80684b0 con 0x7f68e80d02b0 2024-05-08T21:01:56.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.298+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68d80075c0 con 0x7f68e80d02b0 2024-05-08T21:01:56.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.298+0000 7f68ddffb700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f68cc066760 0x7f68cc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:56.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.298+0000 7f68ec800700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f68cc066760 0x7f68cc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:56.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.298+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5998+0+0 (secure 0 0 0) 0x7f68d8083610 con 0x7f68e80d02b0 2024-05-08T21:01:56.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.298+0000 7f68ec800700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f68cc066760 0x7f68cc068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f68e80b8190 tx=0x7f68e4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:56.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.306+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f68d8050860 con 0x7f68e80d02b0 2024-05-08T21:01:56.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:56.470+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68e806b060 con 0x7f68e80d02b0 2024-05-08T21:01:57.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.142+0000 7f68ddffb700 1 -- 172.21.15.107:0/3555863762 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68d8053e80 con 0x7f68e80d02b0 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f68cc066760 msgr2=0x7f68cc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f68cc066760 0x7f68cc068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f68e80b8190 tx=0x7f68e4009240 comp rx=0 tx=0).stop 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 msgr2=0x7f68e80b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 0x7f68e80b77b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c4d0 tx=0x7f68d800c7e0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 shutdown_connections 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68e815d300 0x7f68e814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f68cc066760 0x7f68cc068c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f68e80d0c30 0x7f68e814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 --2- 172.21.15.107:0/3555863762 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68e80d02b0 0x7f68e80b77b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 >> 172.21.15.107:0/3555863762 conn(0x7f68e809c3b0 msgr2=0x7f68e806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:57.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 shutdown_connections 2024-05-08T21:01:57.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.146+0000 7f68ee003700 1 -- 172.21.15.107:0/3555863762 wait complete. 2024-05-08T21:01:57.156 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' removed 2024-05-08T21:01:57.171 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T21:01:57.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.278+0000 7f24b189e700 1 Processor -- start 2024-05-08T21:01:57.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.278+0000 7f24b189e700 1 -- start start 2024-05-08T21:01:57.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f24a40e33a0 0x7f24a4058950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:57.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24a4007280 0x7f24a4007710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:57.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40578b0 con 0x7f24a403ebd0 2024-05-08T21:01:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40576c0 con 0x7f24a4007280 2024-05-08T21:01:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a4007c50 con 0x7f24a40e33a0 2024-05-08T21:01:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24abfff700 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f24a403ebd0 0x7f24a4056fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:53248/0 (socket says 172.21.15.107:53248) 2024-05-08T21:01:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b109d700 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24a4007280 0x7f24a4007710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24abfff700 1 -- 172.21.15.107:0/1677300885 learned_addr learned my addr 172.21.15.107:0/1677300885 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-08T21:01:57.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b089c700 1 --2- 172.21.15.107:0/1677300885 >> v2:172.21.15.195:3300/0 conn(0x7f24a40e33a0 0x7f24a4058950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b109d700 1 -- 172.21.15.107:0/1677300885 >> v2:172.21.15.195:3300/0 conn(0x7f24a40e33a0 msgr2=0x7f24a4058950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b109d700 1 --2- 172.21.15.107:0/1677300885 >> v2:172.21.15.195:3300/0 conn(0x7f24a40e33a0 0x7f24a4058950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b109d700 1 -- 172.21.15.107:0/1677300885 >> v1:172.21.15.107:6789/0 conn(0x7f24a403ebd0 legacy=0x7f24a4056fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24ab7fe700 1 -- 172.21.15.107:0/1677300885 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193154663 0 0) 0x7f24a40578b0 con 0x7f24a403ebd0 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b109d700 1 -- 172.21.15.107:0/1677300885 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4057b90 con 0x7f24a4007280 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b109d700 1 --2- 172.21.15.107:0/1677300885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a4007710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24ac000b60 tx=0x7f24ac068970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252f310265b8da04 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24ab7fe700 1 -- 172.21.15.107:0/1677300885 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac068790 con 0x7f24a4007280 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24ab7fe700 1 -- 172.21.15.107:0/1677300885 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f24ac0679b0 con 0x7f24a4007280 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24ab7fe700 1 -- 172.21.15.107:0/1677300885 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac067d60 con 0x7f24a4007280 2024-05-08T21:01:57.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- 172.21.15.107:0/1677300885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 msgr2=0x7f24a4007710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 --2- 172.21.15.107:0/1677300885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a4007710 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f24ac000b60 tx=0x7f24ac068970 comp rx=0 tx=0).stop 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- 172.21.15.107:0/1677300885 shutdown_connections 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 --2- 172.21.15.107:0/1677300885 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a4007710 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 --2- 172.21.15.107:0/1677300885 >> v2:172.21.15.195:3300/0 conn(0x7f24a40e33a0 0x7f24a4058950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- 172.21.15.107:0/1677300885 >> 172.21.15.107:0/1677300885 conn(0x7f24a4055a10 msgr2=0x7f24a4055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- 172.21.15.107:0/1677300885 shutdown_connections 2024-05-08T21:01:57.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.282+0000 7f24b189e700 1 -- 172.21.15.107:0/1677300885 wait complete. 2024-05-08T21:01:57.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 Processor -- start 2024-05-08T21:01:57.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 -- start start 2024-05-08T21:01:57.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a417bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24a403ebd0 0x7f24a4178cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a40e33a0 0x7f24a4038b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a417a160 con 0x7f24a4007280 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a417bff0 con 0x7f24a40e33a0 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b189e700 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a41797b0 con 0x7f24a403ebd0 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b089c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a417bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b089c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a417bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38006/0 (socket says 172.21.15.107:38006) 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.286+0000 7f24b089c700 1 -- 172.21.15.107:0/2924064017 learned_addr learned my addr 172.21.15.107:0/2924064017 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b109d700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a40e33a0 0x7f24a4038b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24abfff700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24a403ebd0 0x7f24a4178cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:57.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b089c700 1 -- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24a403ebd0 msgr2=0x7f24a4178cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b089c700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24a403ebd0 0x7f24a4178cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b089c700 1 -- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a40e33a0 msgr2=0x7f24a4038b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b089c700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a40e33a0 0x7f24a4038b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b089c700 1 -- 172.21.15.107:0/2924064017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac04f5c0 con 0x7f24a4007280 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b089c700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a417bab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f249800e840 tx=0x7f249800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980095a0 con 0x7f24a4007280 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f249800c690 con 0x7f24a4007280 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800ca20 con 0x7f24a4007280 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a4179a90 con 0x7f24a4007280 2024-05-08T21:01:57.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40e47d0 con 0x7f24a4007280 2024-05-08T21:01:57.301 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a4005440 con 0x7f24a4007280 2024-05-08T21:01:57.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.290+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f249800cb80 con 0x7f24a4007280 2024-05-08T21:01:57.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.294+0000 7f24a97fa700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2490066730 0x7f2490068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T21:01:57.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.294+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5560+0+0 (secure 0 0 0) 0x7f24980841c0 con 0x7f24a4007280 2024-05-08T21:01:57.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.294+0000 7f24abfff700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2490066730 0x7f2490068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T21:01:57.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.294+0000 7f24abfff700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2490066730 0x7f2490068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000f60 tx=0x7f24a0007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T21:01:57.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.298+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175322 (secure 0 0 0) 0x7f24980514a0 con 0x7f24a4007280 2024-05-08T21:01:57.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:57.470+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f24a4038710 con 0x7f24a4007280 2024-05-08T21:01:58.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.146+0000 7f24a97fa700 1 -- 172.21.15.107:0/2924064017 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f24980533d0 con 0x7f24a4007280 2024-05-08T21:01:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2490066730 msgr2=0x7f2490068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2490066730 0x7f2490068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24a0000f60 tx=0x7f24a0007c00 comp rx=0 tx=0).stop 2024-05-08T21:01:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 msgr2=0x7f24a417bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T21:01:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a417bab0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f249800e840 tx=0x7f249800ec00 comp rx=0 tx=0).stop 2024-05-08T21:01:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 shutdown_connections 2024-05-08T21:01:58.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24a40e33a0 0x7f24a4038b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:6832/25996,v1:172.21.15.107:6833/25996] conn(0x7f2490066730 0x7f2490068bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f24a403ebd0 0x7f24a4178cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 --2- 172.21.15.107:0/2924064017 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24a4007280 0x7f24a417bab0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T21:01:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 >> 172.21.15.107:0/2924064017 conn(0x7f24a4055a10 msgr2=0x7f24a4058850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T21:01:58.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 shutdown_connections 2024-05-08T21:01:58.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-08T21:01:58.150+0000 7f24b189e700 1 -- 172.21.15.107:0/2924064017 wait complete. 2024-05-08T21:01:58.160 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' removed 2024-05-08T21:01:58.173 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T21:01:58.173 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-08T21:01:58.173 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:01:58.184 INFO:tasks.ceph.mds.a:Stopped 2024-05-08T21:01:58.184 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-08T21:01:58.184 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:01:58.196 INFO:tasks.ceph.mds.c:Stopped 2024-05-08T21:01:58.197 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-08T21:01:58.197 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:01:58.210 INFO:tasks.ceph.mds.b:Stopped 2024-05-08T21:01:58.212 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-08T21:01:58.212 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:01:58.225 INFO:tasks.ceph.mds.d:Stopped 2024-05-08T21:01:58.226 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T21:01:58.226 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T21:01:58.226 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:02.927 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-08T21:02:04.328 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T21:02:04.329 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T21:02:04.329 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:04.408 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T21:02:04.409 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T21:02:04.409 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:04.503 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T21:02:04.504 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T21:02:04.504 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:08.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-08T21:02:08.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-08T21:02:10.606 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T21:02:10.606 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T21:02:10.606 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:10.687 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T21:02:10.687 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T21:02:10.687 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:11.501 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:11.504 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:14.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-08T21:02:14.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-08T21:02:16.789 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T21:02:16.790 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T21:02:16.790 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:20.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-08T21:02:20.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-08T21:02:22.892 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T21:02:22.892 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T21:02:22.892 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:22.990 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T21:02:22.990 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T21:02:22.991 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T21:02:22.991 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:23.025 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T21:02:23.025 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T21:02:23.026 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:23.058 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T21:02:23.059 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T21:02:23.059 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T21:02:23.059 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:23.103 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T21:02:23.104 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T21:02:23.104 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:23.153 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T21:02:23.154 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T21:02:23.154 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T21:02:23.196 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T21:02:23.196 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T21:02:23.196 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-08T21:02:23.219 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:02:23.219 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T21:02:23.537 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:02:23.538 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T21:02:23.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:02:23.860 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T21:02:24.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:02:24.044 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T21:02:24.213 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:02:24.213 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T21:02:24.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:02:24.483 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T21:02:24.661 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:02:24.661 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T21:02:24.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:02:24.859 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T21:02:25.033 INFO:tasks.ceph:Archiving mon data... 2024-05-08T21:02:25.034 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/data/mon.a.tgz 2024-05-08T21:02:25.034 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-08T21:02:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.5rTOWqh0Gz 2024-05-08T21:02:25.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5rTOWqh0Gz 2024-05-08T21:02:25.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-08T21:02:25.163 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.5rTOWqh0Gz 2024-05-08T21:02:25.185 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.5rTOWqh0Gz is 305KB 2024-05-08T21:02:25.246 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.5rTOWqh0Gz 2024-05-08T21:02:25.252 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/data/mon.b.tgz 2024-05-08T21:02:25.253 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-05-08T21:02:25.259 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.DJbWLCYyCC 2024-05-08T21:02:25.260 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.DJbWLCYyCC 2024-05-08T21:02:25.410 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.DJbWLCYyCC 2024-05-08T21:02:25.436 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.DJbWLCYyCC is 407KB 2024-05-08T21:02:25.497 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.DJbWLCYyCC 2024-05-08T21:02:25.504 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/data/mon.c.tgz 2024-05-08T21:02:25.504 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-05-08T21:02:25.553 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.LkKAsrVcFf 2024-05-08T21:02:25.554 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LkKAsrVcFf 2024-05-08T21:02:25.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.LkKAsrVcFf 2024-05-08T21:02:25.685 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.LkKAsrVcFf is 407KB 2024-05-08T21:02:25.751 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.LkKAsrVcFf 2024-05-08T21:02:25.759 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T21:02:25.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:02:25.762 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T21:02:25.819 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-08T21:02:25.819 DEBUG:teuthology.orchestra.run.smithi107:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:02:25.821 DEBUG:teuthology.orchestra.run.smithi195:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-08T21:02:25.846 INFO:teuthology.orchestra.run.smithi195.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:02:25.846 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-08T21:02:25.852 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T21:02:25.853 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/remote/smithi107/crash 2024-05-08T21:02:25.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:02:25.869 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/remote/smithi195/crash 2024-05-08T21:02:25.870 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T21:02:25.885 INFO:tasks.ceph:Shutting down logrotate 2024-05-08T21:02:25.886 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:25.888 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:25.981 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:25.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-08T21:02:26.013 INFO:tasks.ceph:Compressing logs... 2024-05-08T21:02:26.013 DEBUG:teuthology.orchestra.run.smithi107:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:02:26.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:02:39.141 INFO:tasks.ceph:Archiving logs... 2024-05-08T21:02:39.142 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/remote/smithi107/log 2024-05-08T21:02:39.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:02:40.033 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/remote/smithi195/log 2024-05-08T21:02:40.034 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T21:02:41.599 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T21:02:41.608 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T21:02:41.608 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:02:41.611 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T21:02:41.691 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T21:02:41.701 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T21:02:41.701 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:02:41.704 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T21:02:41.726 INFO:teuthology.orchestra.run.smithi195.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T21:02:41.727 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================== 2024-05-08T21:02:41.727 INFO:teuthology.orchestra.run.smithi195.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.093 -0.504 0.699 2024-05-08T21:02:41.727 INFO:teuthology.orchestra.run.smithi195.stdout:+hv02.front.sepi 63.231.80.2 3 u 28 64 377 0.086 2.714 0.794 2024-05-08T21:02:41.727 INFO:teuthology.orchestra.run.smithi195.stdout:*hv03.front.sepi 74.6.168.72 3 u 32 64 377 0.096 -0.034 0.520 2024-05-08T21:02:41.727 INFO:teuthology.orchestra.run.smithi195.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-05-08T21:02:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T21:02:41.729 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-05-08T21:02:41.729 INFO:teuthology.orchestra.run.smithi107.stdout:+hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.084 0.675 1.072 2024-05-08T21:02:41.729 INFO:teuthology.orchestra.run.smithi107.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 64 377 0.083 3.440 0.890 2024-05-08T21:02:41.729 INFO:teuthology.orchestra.run.smithi107.stdout:*hv03.front.sepi 74.6.168.72 3 u 27 64 377 0.086 2.098 1.156 2024-05-08T21:02:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-05-08T21:02:41.730 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T21:02:41.764 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T21:02:41.765 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T21:02:41.780 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T21:02:41.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T21:02:41.868 INFO:teuthology.task.internal:Duration was 1011.896302 seconds 2024-05-08T21:02:41.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T21:02:41.885 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T21:02:41.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:02:41.888 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T21:02:41.942 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T21:02:41.942 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-05-08T21:02:41.943 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:02:41.955 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-05-08T21:02:41.955 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T21:02:41.966 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T21:02:41.966 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:02:42.001 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T21:02:42.041 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T21:02:42.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:02:42.043 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T21:02:42.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T21:02:42.166 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T21:02:42.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:02:42.184 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T21:02:42.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T21:02:42.212 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:02:42.229 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:02:42.242 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-05-08T21:02:42.257 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-05-08T21:02:42.274 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:02:42.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:02:42.280 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T21:02:42.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T21:02:42.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T21:02:42.296 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T21:02:42.297 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/remote/smithi107 2024-05-08T21:02:42.297 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:02:42.324 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698022/remote/smithi195 2024-05-08T21:02:42.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T21:02:42.349 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T21:02:42.349 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:02:42.365 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T21:02:42.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T21:02:42.404 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T21:02:42.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T21:02:42.431 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T21:02:42.431 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:02:42.433 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T21:02:42.439 INFO:teuthology.orchestra.run.smithi107.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:02 /home/ubuntu/cephtest 2024-05-08T21:02:42.441 INFO:teuthology.orchestra.run.smithi195.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 21:02 /home/ubuntu/cephtest 2024-05-08T21:02:42.443 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T21:02:42.472 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T21:02:42.583 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/workunit/dir-max-entries} duration: 1011.8963015079498 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T21:02:42.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T21:02:42.669 INFO:teuthology.run:pass